-- Logs begin at Tue 2021-11-09 04:18:24 UTC, end at Tue 2021-11-09 05:49:35 UTC. -- Nov 09 04:48:03.982972 dv-cinder-817135-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 09 04:48:03.990837 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 04:48:03 2021] *** Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: nodename: dv-cinder-817135-2-iscsi Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: machine: x86_64 Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: clock source: unix Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: pcre jit disabled Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: detected number of CPU cores: 4 Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: current working directory: / Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: detected binary path: /usr/bin/uwsgi-core Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: your processes number limit is 47680 Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: your memory page size is 4096 bytes Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: detected max file descriptor number: 2048 Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: lock engine: pthread robust mutexes Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: thunder lock: enabled Nov 09 04:48:03.994433 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 09 04:48:03.995354 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 04:48:04.038254 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: Python main interpreter initialized at 0x5649087079c0 Nov 09 04:48:04.038254 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: python threads support enabled Nov 09 04:48:04.038254 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: your server socket listen backlog is limited to 100 connections Nov 09 04:48:04.038254 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: your mercy for graceful operations on workers is 90 seconds Nov 09 04:48:04.038615 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 04:48:04.038701 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: *** Operational MODE: preforking *** Nov 09 04:48:04.038927 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: *** uWSGI is running in multiple interpreter mode *** Nov 09 04:48:04.038927 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: spawned uWSGI master process (pid: 100278) Nov 09 04:48:04.039114 dv-cinder-817135-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 09 04:48:04.039806 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: spawned uWSGI worker 1 (pid: 100279, cores: 1) Nov 09 04:48:04.040004 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: spawned uWSGI worker 2 (pid: 100280, cores: 1) Nov 09 04:48:04.040171 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 04:48:05.685721 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:48:05.685721 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: from cryptography.utils import int_from_bytes Nov 09 04:48:05.686356 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:48:05.686356 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: from cryptography.utils import int_from_bytes Nov 09 04:48:05.692654 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:48:05.692654 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: from cryptography.utils import int_from_bytes Nov 09 04:48:05.693146 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:48:05.693146 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: from cryptography.utils import int_from_bytes Nov 09 04:48:08.279817 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:48:08.280471 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:48:08.280571 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:48:08.280751 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:48:08.281131 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:48:08.281219 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:48:08.281304 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:48:08.281486 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:48:08.281589 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.281806 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.281895 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:48:08.282101 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:48:08.282201 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.282945 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.283056 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.283272 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.283372 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.283575 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.283963 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.284199 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.284290 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.284516 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.284609 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.284832 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.284925 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.285087 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.285176 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.285398 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.285490 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.285717 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817135-2-iscsi {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.285812 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286033 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286122 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286335 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286427 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286642 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286731 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817135-2-iscsi {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.286954 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287043 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287253 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287336 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287569 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287680 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287904 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.287993 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.288226 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.288399 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.288547 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.289681 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.289878 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.290074 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.290230 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.290722 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.290908 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.291057 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.291269 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.291457 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.291671 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.291868 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.292049 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.292237 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.292426 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.292618 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.292818 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.292968 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.293182 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.293363 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.293518 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.293724 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817135-2-iscsi {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.293912 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.294104 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.294303 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.294485 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.294745 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817135-2-iscsi {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.294906 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295027 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295178 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295306 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295460 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295590 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295738 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.295880 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296012 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296171 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296301 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296426 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296560 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296681 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296799 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.296917 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297042 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297170 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297298 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297425 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297574 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297703 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.297828 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.298030 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.298665 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.298788 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.298916 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299036 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299164 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299296 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299426 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299426 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299715 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299845 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.299966 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300203 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300358 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300485 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300611 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300737 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300858 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.300985 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301117 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301246 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301376 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301502 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301642 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301769 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.301897 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302018 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302138 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302262 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302391 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302517 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302645 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302772 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.302899 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303031 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303160 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303285 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303405 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303523 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303659 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303796 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.303919 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304038 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304163 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304288 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304408 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304538 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304658 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304857 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.304988 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305117 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305246 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305377 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305503 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305628 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305753 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.305872 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306003 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306122 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306241 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306359 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306484 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306603 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306733 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306853 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.306977 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307102 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307221 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307346 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307481 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307607 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307796 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.307931 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.308115 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.308239 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.308434 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.308558 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.308740 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.308862 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309049 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309186 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309313 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309432 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309600 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309722 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.309920 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310061 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310208 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310331 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310510 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310637 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310810 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.310944 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.311110 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.311231 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.311406 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.311528 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.311729 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.311870 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312032 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312165 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312334 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312463 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312635 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312763 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.312935 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313056 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313234 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313357 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313559 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313683 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313870 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.313992 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.314171 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.314301 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.314483 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.314606 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.314790 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.314988 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315112 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315236 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315367 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315494 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315691 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315817 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.315995 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.316139 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.316310 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.316435 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.316612 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.316735 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.316914 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317036 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317215 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317339 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317521 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317645 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317822 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.317946 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.318123 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.318246 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.318425 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.318553 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.318725 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.318849 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319028 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319158 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319323 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319445 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319636 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319777 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.319954 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320082 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320255 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320378 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320557 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320688 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320853 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.320976 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.321152 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.321274 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.321452 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.321587 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.321755 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.321877 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322051 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322180 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322352 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322487 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322646 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322777 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.322950 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.323073 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.323254 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.323385 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.323556 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.323695 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.323887 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324010 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324191 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324325 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324505 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324628 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324811 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.324934 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.325206 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.325331 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.325459 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.325588 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.325707 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:48:08.325832 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.326037 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.326167 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.326369 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.326498 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.326699 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.326830 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327005 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327129 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327315 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327438 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327676 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327820 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.327968 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.328098 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.328277 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.328400 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.328585 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.328721 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.328898 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329021 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329231 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329352 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329547 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329671 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329857 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.329979 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.330168 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.330311 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.330481 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.330617 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.330788 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.330918 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.331099 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.331224 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.331415 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.331549 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.331748 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.331871 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.332056 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.332185 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.332370 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.332493 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.332704 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.332827 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333010 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333131 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333322 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333446 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333633 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333756 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.333950 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.334074 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.334259 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.334384 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.334569 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.334699 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.334877 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335001 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335212 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335348 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335505 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335676 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335836 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.335972 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.336148 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.336276 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.336465 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.336594 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.336777 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.336908 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337075 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337204 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337376 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337507 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337678 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337810 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.337985 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.338109 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.338285 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.338410 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.338601 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.338735 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.338905 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339029 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339208 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339330 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339511 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339659 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339850 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.339985 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.340160 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.340284 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.340467 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.340591 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.340767 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.340890 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341074 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341207 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341381 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341512 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341681 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341805 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.341986 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.342108 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.342292 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.342415 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.342593 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.342717 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.342901 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343037 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343199 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343321 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343497 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343702 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343829 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.343965 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.344127 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.344251 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.344433 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.344556 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.344733 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.345427 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.345559 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.345680 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.345856 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.345979 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.346159 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.346293 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.346468 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.346589 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.346791 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.346915 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.347090 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.347218 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.347402 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.347524 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.347742 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.347865 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348066 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348190 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348345 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348468 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348650 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348774 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.348953 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.349091 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.349252 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.349404 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.349551 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.349706 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.349914 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350043 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350163 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350288 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350419 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350547 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350722 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.350846 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351021 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351145 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351318 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351450 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351679 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351805 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.351939 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352058 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352240 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352375 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352540 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352663 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352839 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.352962 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.353164 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.353295 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.353464 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.353592 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.353765 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.353889 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.354067 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.354191 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.354409 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.354533 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.354714 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.354837 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355022 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355145 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355337 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355537 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355681 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355814 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.355965 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.356096 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.356274 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.356406 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.356580 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.356711 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.356894 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357052 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357199 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357329 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357508 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357634 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357813 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.357936 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.358130 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.358251 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.358436 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.358568 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.358751 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.358873 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.359049 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.359172 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.359361 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.359494 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.359688 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.359829 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.360009 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.360139 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.360315 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.360481 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.361205 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.361336 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.361516 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.361648 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.361830 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.361962 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.362140 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.362270 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.362447 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.362570 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.362750 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.362881 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.363057 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.363182 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.363372 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.363495 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.363698 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.363817 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364048 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364165 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364324 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364449 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364641 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364768 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.364946 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365075 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365259 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365390 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365602 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365734 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365862 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.365983 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.366173 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.366295 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.366492 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.366616 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.366796 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.366927 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.367102 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.367237 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.367425 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.367548 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.367758 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.367896 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368070 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368206 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368383 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368507 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368689 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368818 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.368991 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.369127 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.369305 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.369427 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.369617 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.369740 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.369927 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370062 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370234 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370363 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370537 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370662 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370853 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.370977 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.371158 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.371287 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.371461 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.371585 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.371788 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.371906 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.372099 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.372224 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.372409 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.372531 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.372719 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.372850 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373024 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373147 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373338 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373458 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373638 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373761 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.373942 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.374065 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.374270 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.374402 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.374581 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.374711 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.374884 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375022 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375187 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375320 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375489 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375612 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375851 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.375970 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.376156 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.376293 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.376463 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.376585 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.376771 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.376892 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.377094 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.377288 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.377416 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.377540 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.377699 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.377820 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378008 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378130 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378317 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378450 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378629 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378756 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.378938 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.379059 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.379246 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.379367 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.379554 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.379697 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.379888 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380013 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380195 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380325 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380503 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380620 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380814 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.380937 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.381120 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.381241 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.381429 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.381561 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.381737 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.381860 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382034 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382156 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382341 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382472 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382656 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382779 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.382966 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.383219 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.383343 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.383550 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.383730 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.383888 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.384012 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.384209 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.384445 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.384577 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.384779 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.384902 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.385094 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.385217 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.385414 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.385538 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.385734 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.385935 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386057 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386175 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386327 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386457 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386628 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386752 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.386931 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387054 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387239 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387363 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387540 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387680 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387863 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.387986 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.388164 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.388289 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.388471 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.388594 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.388770 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.388902 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389070 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389199 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389371 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389493 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389679 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389813 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.389981 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.390111 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.390277 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.390398 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.390584 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.390707 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.390882 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.391007 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.391199 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.391334 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.391501 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.391673 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.391865 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392003 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392166 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392288 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392467 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392602 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392790 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.392921 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.393091 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.393213 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.393393 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.393516 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.393698 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.393830 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394041 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394173 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394347 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394478 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394646 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394777 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.394965 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.395089 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.395265 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.395389 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.395564 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.395721 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.395887 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396089 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396220 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396340 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396468 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396596 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396771 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.396896 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397076 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397206 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397379 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397504 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397685 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397809 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.397992 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.398116 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.398292 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.398417 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.398598 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.398721 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.398898 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399029 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399205 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399335 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399504 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399650 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399824 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.399966 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.400124 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.400255 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.400430 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.400555 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.400734 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.400934 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401063 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401188 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401308 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401436 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401617 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401748 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.401923 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402052 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402224 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402346 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402525 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402649 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402824 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.402947 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.403130 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.403254 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.403434 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.403559 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.403760 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.404072 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.404385 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.404698 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.405343 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.405343 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.405880 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406005 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406211 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406343 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406473 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406601 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406730 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406850 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.406979 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.407108 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.407234 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.407974 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.408158 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.408286 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.408406 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.408618 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.408743 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.408933 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.409187 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.409316 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.409514 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.409648 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.409822 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.409947 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.410128 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.410258 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.410434 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.410567 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.410746 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.410872 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411050 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411173 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411352 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411477 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411676 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411804 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.411979 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.412103 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.412280 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.412410 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.412584 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.412707 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.412887 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413019 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413187 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413317 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413489 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413621 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413791 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.413914 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.414097 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.414219 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.414400 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.414523 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.414742 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.414874 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.415046 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.415170 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.415627 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.415752 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.415957 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.416098 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.416302 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.416437 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.416556 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.416675 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.416870 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417003 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417173 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417297 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417486 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417611 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417791 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.417921 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.418099 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.418222 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.418399 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.418522 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.418698 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.418830 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419002 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419130 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419307 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419424 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419614 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419766 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.419954 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.420076 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.420267 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.420392 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.420587 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.420711 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.420887 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421012 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421196 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421321 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421505 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421629 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421814 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.421937 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.422119 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.422242 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.422428 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.422551 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.422736 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.422857 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.423581 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.423745 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.423919 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424051 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424231 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424355 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424541 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424674 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424845 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.424969 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.425155 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.425279 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.425460 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.425592 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.425766 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.425887 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426078 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426206 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426407 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426551 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426673 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426791 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.426975 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.427098 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.427278 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.427402 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.427587 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.427760 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.427915 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.428039 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.428225 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.428348 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.428532 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.428655 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.428932 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429054 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429236 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429361 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429543 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429666 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429850 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.429980 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.430161 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.430293 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.430472 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.430594 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.430775 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.430908 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.431091 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.431219 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.431395 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.431526 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.431804 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432010 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432141 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432261 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432408 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432524 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432709 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.432845 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433017 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433141 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433326 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433448 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433626 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433760 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.433926 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434051 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434225 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434348 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434542 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434665 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434842 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.434972 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.435159 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.435283 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.435463 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.435592 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.435811 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.435934 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.436188 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.436317 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.436527 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.436657 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.436832 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.436956 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.437188 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.437320 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.437507 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.437630 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.437826 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.437950 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.438146 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.438279 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.438447 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.438591 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.438783 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.438905 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.439093 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.439228 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.439413 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.439547 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.439752 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.439885 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440059 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440189 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440371 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440494 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440671 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440792 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.440987 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.441118 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.441290 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.441411 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.441606 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.441727 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.441923 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.442045 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.442235 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.442363 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.442558 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.442679 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.442931 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.443073 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.443271 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.443401 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.443552 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.443705 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.443881 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444005 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444183 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444309 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444492 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444623 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444793 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.444924 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.445093 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.445218 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.445411 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.445538 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.445714 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.445836 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446020 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446143 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446326 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446457 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446658 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446797 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.446919 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447023 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447213 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447337 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447529 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447682 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447853 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.447983 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.448174 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.448298 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.448477 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.448610 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.448795 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.448925 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.449109 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.449232 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.449430 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.449566 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.449721 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.449850 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450033 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450157 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450338 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450464 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450639 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450764 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.450941 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.451072 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.451243 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.451373 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.451548 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.451718 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.451899 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452021 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452208 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452331 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452534 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452658 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452839 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.452961 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.453170 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.453296 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.453480 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.453602 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.453791 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.453927 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.454122 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.454247 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.454448 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.454572 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.454750 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.454882 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455051 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455183 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455359 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455483 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455684 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455823 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.455989 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.456114 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.456289 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.456419 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.456592 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.456731 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.456917 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457039 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457185 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457312 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457463 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457586 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457779 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.457901 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458076 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458198 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458394 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458516 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458695 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458816 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.458993 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.459116 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.459293 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.459416 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.459594 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.459734 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.459928 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.460063 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.460235 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.460360 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.460567 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.460690 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.460870 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461001 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461188 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461311 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461509 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461639 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461815 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.461947 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.462133 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.462258 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.462447 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.462571 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.462760 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.462898 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.463073 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.463197 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.463383 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.463507 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.463715 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.463842 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464030 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464153 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464340 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464464 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464648 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464773 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.464957 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.465082 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.465267 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.465391 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.465584 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.465709 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.465901 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.466097 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.466228 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.466423 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.466723 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.466849 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467045 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467174 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467332 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467456 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467684 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467807 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.467972 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.468096 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.468282 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.468418 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.468592 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.468717 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.468915 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.469075 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.469203 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.469333 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.469517 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.469642 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.470338 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.470463 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.470663 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.470798 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.470985 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.471109 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.471297 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.471420 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.471614 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.471768 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.471934 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.472058 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.472246 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.472370 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.472569 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.472694 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.472887 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473023 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473188 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473320 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473499 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473624 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473808 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.473933 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.474119 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.474257 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.474427 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.474557 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.474733 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.474858 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475041 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475166 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475350 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475480 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475680 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475807 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.475990 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.476117 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.476302 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.476425 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.476608 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.476738 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.476923 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477061 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477249 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477372 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477547 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477684 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477852 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.477976 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.478159 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.478290 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.478472 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.478604 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.478795 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.478983 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.479109 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.479297 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.479614 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.479766 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.479955 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.480079 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.480273 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.480396 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.480587 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.480719 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.480901 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481025 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481218 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481340 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481519 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481649 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481822 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.481953 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.482132 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.482258 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.482437 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.482561 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.482737 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.482860 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.483049 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.483172 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.483356 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.483481 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.483678 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.483805 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484000 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484124 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484308 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484435 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484630 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484833 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.484970 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.485174 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.485987 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.486128 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.486338 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.486462 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.486658 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.486789 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.486972 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.487095 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.487295 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.487428 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.487590 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.487782 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.487904 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488021 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488204 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488329 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488515 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488641 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488822 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.488945 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.489122 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.489247 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.489423 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.489550 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.489728 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.489850 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490033 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490156 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490334 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490460 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490641 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490774 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.490943 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.491067 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.491255 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.491380 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.491557 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.491705 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.491888 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492026 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492190 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492320 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492499 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492622 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492799 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.492933 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.493100 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.493225 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.493400 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.493525 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.493701 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.493834 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494006 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494129 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494303 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494426 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494609 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494743 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.494910 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495041 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495216 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495341 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495515 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495671 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495847 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.495971 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.496150 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.496273 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.496462 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.496580 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.496761 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.496885 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497061 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497186 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497401 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497533 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497654 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497774 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.497973 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.498098 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.498280 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.498404 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.498590 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.498714 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.498894 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.499051 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.499207 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.499338 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.499553 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.499762 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.499900 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.500133 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.500412 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.500543 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.500771 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.500895 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.501128 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.501367 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.501493 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.501715 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.501839 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502012 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502144 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502331 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502463 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502640 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502773 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.502943 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.503086 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.503248 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.503371 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.503555 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.503732 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.503888 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504025 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504195 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504321 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504502 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504626 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504810 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.504944 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.505117 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.505250 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.505428 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.505550 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.505743 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.505868 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506058 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506182 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506367 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506490 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506679 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506804 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.506990 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.507135 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.507287 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.507413 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.507657 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.507794 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.507916 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508036 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508202 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508333 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508524 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508652 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508833 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.508963 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.509133 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.509264 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.509467 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.509598 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.509780 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.509905 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.510087 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.510219 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.510445 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.510576 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.510749 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.510873 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.511066 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.511200 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.511384 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.511509 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.511713 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.511840 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512034 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512159 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512341 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512465 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512663 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512787 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.512988 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.513111 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.513302 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.513426 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.513621 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.513746 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.513922 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514048 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514223 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514348 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514522 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514655 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514830 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.514981 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.515156 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.515280 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.515463 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.515598 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.515802 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.515937 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.516116 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.516246 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.516431 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.516565 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.516761 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.516888 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517080 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517204 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517393 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517524 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517730 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517855 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.517999 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.518123 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.518326 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.518448 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.518631 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.518754 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.518939 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.519084 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.519246 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.519371 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.519550 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.519690 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.519882 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520008 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520190 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520323 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520500 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520622 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520812 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.520948 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.521096 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.521217 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.521418 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.521542 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.521729 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.521865 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522045 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522167 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522355 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522477 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522662 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522794 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.522980 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.523124 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.523284 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.523413 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.523594 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.523747 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.523921 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524053 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524228 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524359 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524540 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524671 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524848 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.524971 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.525160 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.525293 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.525478 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.525602 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.525795 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.525917 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.526118 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.526241 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.526443 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.526572 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.526757 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.526879 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.527080 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.527214 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.527404 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.527528 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.527784 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.527918 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.528039 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.528167 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.528331 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.528448 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.528568 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:48:08.528765 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.529081 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.529389 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:48:08.529633 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:48:08.553260 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_db.sqlalchemy.engines [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:08.553868 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_db.sqlalchemy.engines [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:08.714782 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.context [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37efc4e6-05c3-46b6-81a9-5d64f9690a41(cell1) {{(pid=100280) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 04:48:08.716232 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.context [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37efc4e6-05c3-46b6-81a9-5d64f9690a41(cell1) {{(pid=100279) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 04:48:08.718997 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:48:08.721021 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_concurrency.lockutils [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:48:08.721490 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:48:08.722318 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:48:08.722816 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_concurrency.lockutils [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:48:08.723639 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_concurrency.lockutils [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:48:08.724252 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:48:08.725597 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_concurrency.lockutils [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:48:08.734753 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_db.sqlalchemy.engines [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:08.736937 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_db.sqlalchemy.engines [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:08.741044 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_db.sqlalchemy.engines [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:08.744003 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_db.sqlalchemy.engines [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:09.009195 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG oslo_db.sqlalchemy.engines [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:09.032319 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_db.sqlalchemy.engines [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:48:09.352375 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: WARNING keystonemiddleware.auth_token [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:48:09.359672 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: WARNING keystonemiddleware.auth_token [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:48:09.364144 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: WARNING keystonemiddleware.auth_token [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:48:09.370635 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: WARNING keystonemiddleware.auth_token [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:48:09.705347 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: WARNING keystonemiddleware.auth_token [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:48:09.711436 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: WARNING keystonemiddleware.auth_token [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:48:09.716624 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649087079c0 pid: 100279 (default app) Nov 09 04:48:09.718691 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:48:09.720433 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Nov 09 04:48:09.720852 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Tue Nov 9 04:48:09 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:48:09.727294 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: WARNING keystonemiddleware.auth_token [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:48:09.732481 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: WARNING keystonemiddleware.auth_token [None req-a7511cb2-f1bb-4be5-894f-34cc63fd509b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:48:09.739140 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649087079c0 pid: 100280 (default app) Nov 09 04:49:29.837331 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:29.838911 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Nov 09 04:49:29.839309 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:30.261683 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-f90129ad-5f51-4cb5-918f-b517c4baf14d admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:30.295435 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-f90129ad-5f51-4cb5-918f-b517c4baf14d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444303 Nov 09 04:49:30.296180 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 9 04:49:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:49:32.605105 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:32.606210 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-095d8fe2-85b1-4bdd-a4fd-32339cdff35d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Nov 09 04:49:32.606944 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:32.669198 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-3354b80e-a493-442a-a615-6dbfb87f064c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "swap": 0, "disk": 1}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:32.687712 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:49:32.687712 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: warnings.warn(msg) Nov 09 04:49:32.718493 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-3354b80e-a493-442a-a615-6dbfb87f064c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105111 Nov 09 04:49:32.719262 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:32 2021] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:32.942637 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-433c26cf-09fa-446e-9697-b540b212eefe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:32.945077 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:49:32.945077 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: warnings.warn(msg) Nov 09 04:49:32.992065 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-433c26cf-09fa-446e-9697-b540b212eefe admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264225 Nov 09 04:49:33.001010 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 9 04:49:32 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:49:35.318986 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-3354b80e-a493-442a-a615-6dbfb87f064c admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:35.320657 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-3354b80e-a493-442a-a615-6dbfb87f064c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Nov 09 04:49:35.321215 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:35.442080 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-2028d1db-b3b8-49fb-83b8-35c923235ede admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:35.462041 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:49:35.462041 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: warnings.warn(msg) Nov 09 04:49:35.482800 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-2028d1db-b3b8-49fb-83b8-35c923235ede admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154768 Nov 09 04:49:35.483585 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:35.496363 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-7f032001-8db5-4f05-afe4-df0c56fc51f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:35.497906 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:49:35.497906 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: warnings.warn(msg) Nov 09 04:49:35.538133 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-7f032001-8db5-4f05-afe4-df0c56fc51f5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045350 Nov 09 04:49:35.539003 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 9 04:49:35 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:49:37.846118 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-2028d1db-b3b8-49fb-83b8-35c923235ede admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:37.847110 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-2028d1db-b3b8-49fb-83b8-35c923235ede admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Nov 09 04:49:37.847509 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:37.913900 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-d00e7183-bfcb-4c34-b657-f34b5943cc2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:37.946983 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-d00e7183-bfcb-4c34-b657-f34b5943cc2f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090859 Nov 09 04:49:37.952432 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:37.960630 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-ffa2c0ef-9ce1-41f5-9ec2-549d8bbc45a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:37.986129 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-ffa2c0ef-9ce1-41f5-9ec2-549d8bbc45a7 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029121 Nov 09 04:49:37.987076 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 9 04:49:37 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:49:40.326677 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-d00e7183-bfcb-4c34-b657-f34b5943cc2f admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:40.328256 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-d00e7183-bfcb-4c34-b657-f34b5943cc2f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002734 Nov 09 04:49:40.328876 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:40 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:40.386208 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-bd8b5792-ab04-4898-a617-618b48d34884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:40.405675 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-bd8b5792-ab04-4898-a617-618b48d34884 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069885 Nov 09 04:49:40.406320 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:49:40.420247 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-cf7c0b84-ecef-42ed-8b7d-d0893bc6fa4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:40.443446 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-cf7c0b84-ecef-42ed-8b7d-d0893bc6fa4d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026939 Nov 09 04:49:40.444055 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 9 04:49:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:49:42.810735 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-bd8b5792-ab04-4898-a617-618b48d34884 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:42.811764 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-bd8b5792-ab04-4898-a617-618b48d34884 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Nov 09 04:49:42.812416 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:42.873822 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-1e72431a-993e-4047-891d-52c1848d73da admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:42.894696 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-1e72431a-993e-4047-891d-52c1848d73da admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076085 Nov 09 04:49:42.895905 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:42.908604 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-8d9ca74d-787c-4793-afa2-1feda9f8cf3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:42.932692 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-8d9ca74d-787c-4793-afa2-1feda9f8cf3c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028678 Nov 09 04:49:42.933316 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 9 04:49:42 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:49:45.320210 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-1e72431a-993e-4047-891d-52c1848d73da admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:45.321262 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-1e72431a-993e-4047-891d-52c1848d73da admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Nov 09 04:49:45.321679 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:49:45.387925 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-c86f9cdf-2c6d-410d-95c3-09c6b59af702 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:45.411858 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-c86f9cdf-2c6d-410d-95c3-09c6b59af702 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082225 Nov 09 04:49:45.412405 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 9 04:49:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:49:48.741746 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-1e72431a-993e-4047-891d-52c1848d73da admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:48.743380 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-1e72431a-993e-4047-891d-52c1848d73da admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Nov 09 04:49:48.743855 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:49:48.807310 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-b9818bba-89b0-49ee-a1ac-d29b52970cc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:48.827847 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-b9818bba-89b0-49ee-a1ac-d29b52970cc1 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076357 Nov 09 04:49:48.828336 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:48 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:48.841534 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-2aced34c-b5fd-43d6-b1a6-b3233f9f718e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:48.865565 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-2aced34c-b5fd-43d6-b1a6-b3233f9f718e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028164 Nov 09 04:49:48.866157 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 9 04:49:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:49:51.169688 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-b9818bba-89b0-49ee-a1ac-d29b52970cc1 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:51.170797 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-b9818bba-89b0-49ee-a1ac-d29b52970cc1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Nov 09 04:49:51.171202 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:51.229634 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-b0175fc9-9f1d-4e80-8cae-cd461fddd70f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "disk": 20, "swap": 0}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:51.247207 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-b0175fc9-9f1d-4e80-8cae-cd461fddd70f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069020 Nov 09 04:49:51.247816 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:49:51.259859 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-2917ac65-1f02-4c8d-88af-3117fbe33705 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:51.283543 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-2917ac65-1f02-4c8d-88af-3117fbe33705 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027254 Nov 09 04:49:51.284163 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 9 04:49:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:49:53.544749 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-b0175fc9-9f1d-4e80-8cae-cd461fddd70f admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:53.545759 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-b0175fc9-9f1d-4e80-8cae-cd461fddd70f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Nov 09 04:49:53.546159 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:53.613840 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-7855a235-f280-4875-a00f-43519f5cceb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:53.632173 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-7855a235-f280-4875-a00f-43519f5cceb3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079420 Nov 09 04:49:53.632728 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:53 2021] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:49:53.645295 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-7fbb4d3c-629c-414e-a3d8-7c9ea1f88b40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:53.668752 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-7fbb4d3c-629c-414e-a3d8-7c9ea1f88b40 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026883 Nov 09 04:49:53.669361 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 9 04:49:53 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:49:55.973257 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-7855a235-f280-4875-a00f-43519f5cceb3 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:55.974858 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-7855a235-f280-4875-a00f-43519f5cceb3 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Nov 09 04:49:55.975435 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:56.035747 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-e9d1ffb3-cb4d-4cd4-adad-a544541f7ab6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "name": "m1.large"}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:56.056571 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-e9d1ffb3-cb4d-4cd4-adad-a544541f7ab6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074558 Nov 09 04:49:56.057485 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:56.071103 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-0f6754b9-bf2e-4285-8bd7-30f79043243a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:56.103227 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-0f6754b9-bf2e-4285-8bd7-30f79043243a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035661 Nov 09 04:49:56.119656 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 9 04:49:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:49:58.416679 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-e9d1ffb3-cb4d-4cd4-adad-a544541f7ab6 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:49:58.417708 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-e9d1ffb3-cb4d-4cd4-adad-a544541f7ab6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 09 04:49:58.418150 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:49:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:49:58.480776 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-11aaa0c8-be01-4dac-9b67-388567d4d896 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:58.499480 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-11aaa0c8-be01-4dac-9b67-388567d4d896 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074354 Nov 09 04:49:58.500231 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 9 04:49:58 2021] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:49:58.512833 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-182659f0-1fc5-40ba-8e25-8606aa60391c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:49:58.538642 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-182659f0-1fc5-40ba-8e25-8606aa60391c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029704 Nov 09 04:49:58.551652 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 9 04:49:58 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:50:36.729611 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-11aaa0c8-be01-4dac-9b67-388567d4d896 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:36.730605 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-11aaa0c8-be01-4dac-9b67-388567d4d896 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 09 04:50:36.731002 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:50:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:36.788227 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-d9563e90-826d-4526-b00e-0272524e6993 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:36.804450 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-d9563e90-826d-4526-b00e-0272524e6993 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067109 Nov 09 04:50:36.804970 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 9 04:50:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:50:38.315473 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-11aaa0c8-be01-4dac-9b67-388567d4d896 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:38.316488 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-11aaa0c8-be01-4dac-9b67-388567d4d896 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 09 04:50:38.316879 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:38.504440 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-c53ff666-1619-418d-b5b6-202ebdcd4e03 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:38.509769 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.wsgi [None req-c53ff666-1619-418d-b5b6-202ebdcd4e03 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 09 04:50:38.510323 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-c53ff666-1619-418d-b5b6-202ebdcd4e03 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:50:38.511097 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-c53ff666-1619-418d-b5b6-202ebdcd4e03 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057422 Nov 09 04:50:38.511597 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 9 04:50:38 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:38.521219 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-445b7d06-a912-41c0-8da2-a1ff94eceb37 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:38.542739 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-445b7d06-a912-41c0-8da2-a1ff94eceb37 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024951 Nov 09 04:50:38.543220 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 9 04:50:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:50:38.553044 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-a0df6dad-976c-49e2-b23b-16b85c34fe5a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:38.573942 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-a0df6dad-976c-49e2-b23b-16b85c34fe5a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024281 Nov 09 04:50:38.574491 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 9 04:50:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:50:38.584437 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-0d2064ba-e5ef-462a-a079-bd8fc55bd613 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:38.590514 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.wsgi [None req-0d2064ba-e5ef-462a-a079-bd8fc55bd613 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 09 04:50:38.591079 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-0d2064ba-e5ef-462a-a079-bd8fc55bd613 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:50:38.591884 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-0d2064ba-e5ef-462a-a079-bd8fc55bd613 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011021 Nov 09 04:50:38.592377 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 9 04:50:38 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 09 04:50:39.995783 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-a0df6dad-976c-49e2-b23b-16b85c34fe5a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:39.996803 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-a0df6dad-976c-49e2-b23b-16b85c34fe5a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 09 04:50:39.997222 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:40.185711 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-18550184-53cd-4b73-b4d8-b96205d6f404 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:40.191013 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.wsgi [None req-18550184-53cd-4b73-b4d8-b96205d6f404 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 09 04:50:40.191577 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-18550184-53cd-4b73-b4d8-b96205d6f404 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:50:40.192389 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-18550184-53cd-4b73-b4d8-b96205d6f404 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058166 Nov 09 04:50:40.192895 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 9 04:50:40 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:40.202984 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-88c0035c-cc2a-4c0e-a877-1f96e08f2d42 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:40.217388 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-88c0035c-cc2a-4c0e-a877-1f96e08f2d42 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017858 Nov 09 04:50:40.217864 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 9 04:50:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:50:40.227474 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-11d8ddea-a4ca-4736-b579-4aec85bd19a1 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:40.240593 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-11d8ddea-a4ca-4736-b579-4aec85bd19a1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016454 Nov 09 04:50:40.241103 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 9 04:50:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:50:40.250273 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-2d57fb60-811f-4455-8ff9-818f2e4aaed3 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:40.255308 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.wsgi [None req-2d57fb60-811f-4455-8ff9-818f2e4aaed3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 09 04:50:40.255926 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-2d57fb60-811f-4455-8ff9-818f2e4aaed3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:50:40.256669 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-2d57fb60-811f-4455-8ff9-818f2e4aaed3 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009747 Nov 09 04:50:40.257147 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 9 04:50:40 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 09 04:50:41.667790 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-11d8ddea-a4ca-4736-b579-4aec85bd19a1 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:41.668793 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-11d8ddea-a4ca-4736-b579-4aec85bd19a1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 09 04:50:41.669197 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:41.856673 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-6e424e52-ccad-4b15-968a-04c39ec1906f admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:41.861813 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.wsgi [None req-6e424e52-ccad-4b15-968a-04c39ec1906f admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 09 04:50:41.862365 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-6e424e52-ccad-4b15-968a-04c39ec1906f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:50:41.863138 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-6e424e52-ccad-4b15-968a-04c39ec1906f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057205 Nov 09 04:50:41.863652 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 9 04:50:41 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:41.873177 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-97b93c32-5211-4e09-a837-7eadc55b6fa6 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:41.886746 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-97b93c32-5211-4e09-a837-7eadc55b6fa6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017019 Nov 09 04:50:41.887259 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 9 04:50:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:50:41.897184 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:41.910468 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017037 Nov 09 04:50:41.910997 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 9 04:50:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:50:41.920764 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-f0344bf4-b859-48e4-8b3f-011ab81d6154 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:41.925811 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.wsgi [None req-f0344bf4-b859-48e4-8b3f-011ab81d6154 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 09 04:50:41.926369 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-f0344bf4-b859-48e4-8b3f-011ab81d6154 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:50:41.927145 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-f0344bf4-b859-48e4-8b3f-011ab81d6154 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009787 Nov 09 04:50:41.927645 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 9 04:50:41 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:43.332948 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:43.333978 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 09 04:50:43.334365 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:43.521943 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-8447a275-a903-4529-83c1-6be9fc35ab0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:50:43.540559 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-8447a275-a903-4529-83c1-6be9fc35ab0f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068898 Nov 09 04:50:43.541026 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 9 04:50:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:50:44.960790 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:44.961800 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Nov 09 04:50:44.962192 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:45.147706 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-d4a5c58b-89c5-4ee8-8406-707790d94f51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:50:45.164764 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-d4a5c58b-89c5-4ee8-8406-707790d94f51 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067180 Nov 09 04:50:45.165295 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 9 04:50:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:50:46.585483 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:46.586540 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 09 04:50:46.586931 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:46.784108 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-6ad351c2-710b-4a9e-a88a-a919964141d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:50:46.802754 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-6ad351c2-710b-4a9e-a88a-a919964141d3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070237 Nov 09 04:50:46.803234 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 9 04:50:46 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:50:48.213790 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:48.214820 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 09 04:50:48.215207 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:48.402143 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-cd122725-7b8c-4e7c-8443-cc643592ac73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:50:48.420159 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-cd122725-7b8c-4e7c-8443-cc643592ac73 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069909 Nov 09 04:50:48.420692 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 9 04:50:48 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:50:49.829538 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:49.830559 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Nov 09 04:50:49.830964 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:50:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:50:50.020438 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-30f41d1b-b4f0-4fb1-a3b6-6b3fb683baf8 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:50:50.039412 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-30f41d1b-b4f0-4fb1-a3b6-6b3fb683baf8 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070295 Nov 09 04:50:50.039989 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Tue Nov 9 04:50:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:51:36.215543 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:51:36.216567 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-555cfce3-0202-48dd-9dd3-641e6634861a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Nov 09 04:51:36.216961 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 9 04:51:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:51:36.273345 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-52a391aa-cabf-43d3-a45d-3e45372a5902 admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:51:36.293266 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-52a391aa-cabf-43d3-a45d-3e45372a5902 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069771 Nov 09 04:51:36.293791 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 9 04:51:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:51:36.315394 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-ad96f21f-f581-4c97-9978-4e8d519bf926 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:51:36.323446 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-ad96f21f-f581-4c97-9978-4e8d519bf926 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011585 Nov 09 04:51:36.323990 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Nov 9 04:51:36 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:51:36.335012 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-aa66fa3d-eacf-4941-8a35-9de83a70edac admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:51:36.343088 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-aa66fa3d-eacf-4941-8a35-9de83a70edac admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 Nov 09 04:51:36.343603 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Nov 9 04:51:36 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:51:36.354928 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-2b9faeed-78ba-4e79-bf5b-8a7d5e4f10d3 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:51:36.362233 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-2b9faeed-78ba-4e79-bf5b-8a7d5e4f10d3 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010685 Nov 09 04:51:36.362748 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Nov 9 04:51:36 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:51:36.374345 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:51:36.381610 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010716 Nov 09 04:51:36.382112 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Nov 9 04:51:36 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:53:04.512147 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-b1a16953-7350-41cc-a21d-46f47e5e2250 tempest-verify_tempest_config-1514471055 tempest-verify_tempest_config-1514471055-project] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:53:04.514122 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-b1a16953-7350-41cc-a21d-46f47e5e2250 tempest-verify_tempest_config-1514471055 tempest-verify_tempest_config-1514471055-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105246 Nov 09 04:53:04.514688 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 9 04:53:04 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:54:32.529324 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:32.530309 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Nov 09 04:54:32.530705 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 36/70] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:54:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:54:32.781317 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-086590c6-d02f-44f0-9759-9a4356d62650 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:32.782464 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:54:32.782464 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: warnings.warn(msg) Nov 09 04:54:32.784656 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-086590c6-d02f-44f0-9759-9a4356d62650 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:32.785102 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-086590c6-d02f-44f0-9759-9a4356d62650 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:32.786182 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-086590c6-d02f-44f0-9759-9a4356d62650 admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:32.786608 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-086590c6-d02f-44f0-9759-9a4356d62650 admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:32.819330 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-086590c6-d02f-44f0-9759-9a4356d62650 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146423 Nov 09 04:54:32.819915 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 35/71] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 9 04:54:32 2021] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:54:34.248665 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:34.249662 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Nov 09 04:54:34.250056 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 37/72] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:54:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:54:34.448158 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-b3225274-3c4c-40b4-9f5b-46ff48dd6330 admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:34.449364 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:54:34.449364 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: warnings.warn(msg) Nov 09 04:54:34.450919 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-b3225274-3c4c-40b4-9f5b-46ff48dd6330 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:34.451367 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-b3225274-3c4c-40b4-9f5b-46ff48dd6330 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:34.452208 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-b3225274-3c4c-40b4-9f5b-46ff48dd6330 admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:34.452643 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-b3225274-3c4c-40b4-9f5b-46ff48dd6330 admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:34.472267 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-b3225274-3c4c-40b4-9f5b-46ff48dd6330 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075091 Nov 09 04:54:34.472760 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 36/73] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 9 04:54:34 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:54:46.320904 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:46.321887 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Nov 09 04:54:46.322284 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 38/74] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:54:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:54:46.514862 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-ff3fbf1c-eef4-48c4-85c8-c9754fbc06fb admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:46.516652 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:54:46.516652 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: warnings.warn(msg) Nov 09 04:54:46.519599 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-ff3fbf1c-eef4-48c4-85c8-c9754fbc06fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:46.520295 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-ff3fbf1c-eef4-48c4-85c8-c9754fbc06fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:46.521101 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-ff3fbf1c-eef4-48c4-85c8-c9754fbc06fb admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:46.521531 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-ff3fbf1c-eef4-48c4-85c8-c9754fbc06fb admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:46.547599 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-ff3fbf1c-eef4-48c4-85c8-c9754fbc06fb admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086956 Nov 09 04:54:46.548146 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 37/75] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 9 04:54:46 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:54:47.964196 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: DEBUG nova.api.openstack.wsgi [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] Calling method '>' {{(pid=100279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:47.965182 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: INFO nova.api.openstack.requestlog [None req-13651132-64e7-4ebe-89a7-9c4ac5097b8b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 09 04:54:47.965575 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: [pid: 100279|app: 0|req: 39/76] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 9 04:54:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:54:48.165407 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG nova.api.openstack.wsgi [None req-c906b6a0-6f56-45de-8143-48081afbca8e admin admin] Calling method '>' {{(pid=100280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:54:48.166551 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:54:48.166551 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: warnings.warn(msg) Nov 09 04:54:48.168094 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-c906b6a0-6f56-45de-8143-48081afbca8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:48.168532 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-c906b6a0-6f56-45de-8143-48081afbca8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:48.169327 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-c906b6a0-6f56-45de-8143-48081afbca8e admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:54:48.169753 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: DEBUG oslo_concurrency.lockutils [None req-c906b6a0-6f56-45de-8143-48081afbca8e admin admin] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:54:48.190306 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: INFO nova.api.openstack.requestlog [None req-c906b6a0-6f56-45de-8143-48081afbca8e admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075764 Nov 09 04:54:48.190783 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: [pid: 100280|app: 0|req: 38/77] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 9 04:54:48 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:55:46.763309 dv-cinder-817135-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 09 04:55:46.763827 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: Tue Nov 9 04:55:46 2021 - graceful shutdown triggered... Nov 09 04:55:46.764262 dv-cinder-817135-2-iscsi devstack@n-api.service[100279]: Gracefully killing worker 1 (pid: 100279)... Nov 09 04:55:46.764629 dv-cinder-817135-2-iscsi devstack@n-api.service[100280]: Gracefully killing worker 2 (pid: 100280)... Nov 09 04:55:47.764771 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: worker 1 buried after 1 seconds Nov 09 04:55:47.765191 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: worker 2 buried after 1 seconds Nov 09 04:55:47.765191 dv-cinder-817135-2-iscsi devstack@n-api.service[100278]: goodbye to uWSGI. Nov 09 04:55:47.766352 dv-cinder-817135-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 09 04:55:47.766901 dv-cinder-817135-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 09 04:55:47.769697 dv-cinder-817135-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 09 04:55:47.779207 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 04:55:47 2021] *** Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: nodename: dv-cinder-817135-2-iscsi Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: machine: x86_64 Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: clock source: unix Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: pcre jit disabled Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: detected number of CPU cores: 4 Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: current working directory: / Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: detected binary path: /usr/bin/uwsgi-core Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: your processes number limit is 47680 Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: your memory page size is 4096 bytes Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: detected max file descriptor number: 2048 Nov 09 04:55:47.781096 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: lock engine: pthread robust mutexes Nov 09 04:55:47.782464 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: thunder lock: enabled Nov 09 04:55:47.782464 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 09 04:55:47.782464 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 04:55:47.826653 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: Python main interpreter initialized at 0x558c9d9299c0 Nov 09 04:55:47.826653 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: python threads support enabled Nov 09 04:55:47.826653 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: your server socket listen backlog is limited to 100 connections Nov 09 04:55:47.826653 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: your mercy for graceful operations on workers is 90 seconds Nov 09 04:55:47.827059 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 04:55:47.827059 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: *** Operational MODE: preforking *** Nov 09 04:55:47.827282 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: *** uWSGI is running in multiple interpreter mode *** Nov 09 04:55:47.827282 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: spawned uWSGI master process (pid: 115433) Nov 09 04:55:47.827486 dv-cinder-817135-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 09 04:55:47.828076 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: spawned uWSGI worker 1 (pid: 115445, cores: 1) Nov 09 04:55:47.830232 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: spawned uWSGI worker 2 (pid: 115446, cores: 1) Nov 09 04:55:47.830232 dv-cinder-817135-2-iscsi devstack@n-api.service[115433]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 04:55:49.639400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:55:49.639400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: from cryptography.utils import int_from_bytes Nov 09 04:55:49.640084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:55:49.640084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: from cryptography.utils import int_from_bytes Nov 09 04:55:49.660638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:55:49.660638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: from cryptography.utils import int_from_bytes Nov 09 04:55:49.661192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:55:49.661192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: from cryptography.utils import int_from_bytes Nov 09 04:55:52.265595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:55:52.266171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:55:52.266469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:55:52.266735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:55:52.266993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:55:52.267388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.267822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.268075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.268495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.269078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.269410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.269746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.270081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.270423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.270689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.271012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.271339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817135-2-iscsi {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.271760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.272078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.272396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.272717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.273027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.273353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.273664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.274167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.275528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.275528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.275528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.275970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.276217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.276530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.276847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.277160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.277483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.277805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.278199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817135-2-iscsi {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.278509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.278831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.279135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.279568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.279924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.280233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.280547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.280884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.281776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.282105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.282427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.282751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.283086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.283382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.283716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.284293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.284616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.284924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.285229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.285483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.285795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.286121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.286443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.286766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.287017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.287407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.287599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.287932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.288336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.288663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.288976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.289288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.289606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.289919 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.290228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.290537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.290860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.291180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.291503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.291844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.292165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.292578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.292830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.293140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.293484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.293802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.294113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.294434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.294753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.295062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.295371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.295703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.296026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.296361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.296722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.297533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.297839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.298148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.298465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.298773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.299082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.299389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.299716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.300032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.300339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.300644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.300954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.301264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.301572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.301877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.302188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.302486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.302810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.303128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.303435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.303767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.304073 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.304381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.304699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.305006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.305312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.305632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.305937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.306242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.306564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.306868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.307173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.307490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.307820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.308143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.308443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.308751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.309056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.309362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.309664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.309978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.310286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.310589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.310891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.311191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.311505 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.311852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.312216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.312533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.312841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.313163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.313500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.313833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.314174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.314488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.314819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.315148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.315467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.315806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.316121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.316445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.316761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.317072 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.317384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.317704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.318024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.318353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.318670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.318989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.319307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.319655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.319958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.320299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.320616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.320928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.321269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.321607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.321924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.322249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.322563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.322885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.323199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.323514 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.323848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.324183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.324495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.324806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.325141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.325461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.325779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.326086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.326393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.326700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.327014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.327318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.327666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.328046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.328357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.328695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.329004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.329319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.330059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.330059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.330394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.330542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.330841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.331166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.331479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.331808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.332134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.332446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.332752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.333067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.333383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.333761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.334075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.334406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.334716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.335029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.335363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.335736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.336046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.336371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.336698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.337062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.337316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.337628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.337934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.338240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.338545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.338855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.339160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.339465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.339800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.340107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.340410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.340731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.341042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.341361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.341646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.341948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.342290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.342597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.342779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:55:52.343261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.343488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:55:52.344159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.344304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:55:52.344481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.344642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:55:52.344799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.344955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:55:52.345331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.345483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.345631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.345631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.345900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.346055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.346203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.346351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.346503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.346644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.346792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.346946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.347113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.347345 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.347499 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.347678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.347844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.347986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.348127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.348275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.348275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.348549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.348699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.348854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.349000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.349000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.349285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817135-2-iscsi {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.349439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.349591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.349732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.349880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.350029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.350171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.350319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.350466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.350606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.350746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.350894 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.351061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.351288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.351599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.351859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.351859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.352154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.352325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.352468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.352641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.352891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.353049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.353197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.353359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.353507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.353648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.353788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.353928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.354068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.354223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.354372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.354520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.354667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.354820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.354962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.355124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.355124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.355712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.355860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.355860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.356141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817135-2-iscsi {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.356292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.356433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.356580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.356721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.356953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.357117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.357274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.357528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.357679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.357848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.358159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.358319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.358478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.358772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.358932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.359082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.359919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.360093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.360275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.360431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.361126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.361303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.361557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.361896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.362135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.362135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.362426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.362575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.362727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.362902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.363150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.363306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.363466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.363614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.363614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.363988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.364141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.364141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.364423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.364564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.364564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.364855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.364997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.365145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.365295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.365628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.365791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.365936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.366084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.366332 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.366487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.366698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.366870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.367024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.367167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.367309 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.367449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.367766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.367938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.368091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.368243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.368243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.368526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.368678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.368821 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.368963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.369113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.369334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.369486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.369644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.369839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.369993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.370136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.370283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.370432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.370593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.370741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.370898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.371048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.371197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.371347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.371513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.371982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.372151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.372367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.372524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.372676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.372824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.372973 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.373114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.373452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.373452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.373830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.373830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.374104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.374256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.374398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.374546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.374687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.374850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.375008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.375160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.375160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.375453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.375765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.375765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.376041 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.376182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.376349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.376597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.376597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.376893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.377035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.377035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.377324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.377467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.377621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.377855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.378014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.378163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.378163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.378457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.378598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.378746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.378895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.379045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.379198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.379346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.379488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.379735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.379923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.379923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.380204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.380356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.380356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.380639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.380788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.380788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.381055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.381195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.381334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.381483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.381625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.381774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.382154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.382304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.382557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.382721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.382865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.383014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.383163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.383305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.383474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.383752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.383902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.384052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.384199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.384386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.384547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.384728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.385052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.385198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.385345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.385493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.385647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.385967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.386117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.386305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.386305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.386596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.386841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.386841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.387143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.387285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.387532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.387723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.387887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.388105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.388368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.388531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.388673 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.388813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.388954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.389179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.389344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.389486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.389643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.389861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.390004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.390153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.390307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.390484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.390712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.390855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.391002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.391150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.391299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.391458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.391613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.391791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.391933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.392314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.392471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.392698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.392846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.392988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.393137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.393292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.393435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.393575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.393725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.393866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.394014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.394267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.394415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.394564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.394706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.394845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.394994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.395135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.395276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.395416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.395416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.395739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.395912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.395912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.396340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.396490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.396490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.396757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.397005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.397005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.397288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.397439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.397439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.397717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:55:52.397877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.398020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.398252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.398414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.398558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.398558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.398919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.399067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.399209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.399348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.399489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.399716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.399716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.400874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.401071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.401217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.401373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.401675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.401822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.402021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.402187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.402547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.402723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.402948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.403096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.403246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.403388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.403528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.403713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.403869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.404018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.404177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.404522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.404522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.404819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.404977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.405133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.405288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.405443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.405605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.405764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.405921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.406731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.406897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.407243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.407409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.407566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.407772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.407931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.408080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.408246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.408246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.408617 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.408774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.409175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.409334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.409490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.409667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.409824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.409974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.410223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.410378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.410540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.410696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.410851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.411931 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.412090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.412090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.412591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.412761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.412761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.413143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.413299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.413454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.413617 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.413617 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.413916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.414065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.414214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.414373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.414373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.414770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.414931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.415082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.415238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.415396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.415551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.415724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.415883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.416042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.416298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.416468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.416786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.416958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.417116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.417366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.417522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.417796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.417954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.418327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.418505 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.418846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.419025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.419335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.419502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.419828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.420038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.420326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.420490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.420814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.421007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.421319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.421475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.421879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.422775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.422952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.423125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.423349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.423501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.423701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.423876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.424106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.424335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.424490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.424843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.425053 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.425320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.425615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.425812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.426141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.426296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.426495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.426897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.427071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.427221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.427496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.427814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.427982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.428323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.428477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.428644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.428880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.429067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.429312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.429475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.429709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.429863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.430044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.430318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.430472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.430705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.430857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.431006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.431275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.431439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.431739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.431910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.432068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.432258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.432532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.432919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.433080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.433237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.433480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.433637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.433809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.433972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.434122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.434276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.434431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.434587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.434744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.435589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.435782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.436022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.436182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.436343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.436343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.436850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.436850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.437395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.438307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.447107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.448433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.448592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.448991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449823 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449823 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.449990 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.450887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.454963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.455918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456536 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.456976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457434 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.457928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.458926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.459048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.459342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.459459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.459719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.459895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.460056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.460210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.460361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.460531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.460831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.460934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.461372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.461485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.461812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.461997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.462146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.462476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.462647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.462800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.462972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.463124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.463291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.463438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.463590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.463816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.463926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.464135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.464452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.464542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.464780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.465076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.465175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.465409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.465578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.465730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.465863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.466144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.466244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.466467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.466787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.466879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.467124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.467419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.467521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.467782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.468070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.468164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.468405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.468701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.468866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.469059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.469273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.469470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.469672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.469850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470003 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470626 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.470950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.471949 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.472269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.472395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.472595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.472923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.473055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.473250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.473750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.473881 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.474152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.474519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.474796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.475111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.475710 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.476037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.476252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.476523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.476787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.476985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.477304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.477446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.477818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.477949 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.478293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.478431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.478743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.478962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.479211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.479492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.479849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.479990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.480304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.480452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.480781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.480920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.481144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.481296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.481831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.481974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.482374 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.482523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.482666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.482803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.482940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.483057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.483187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.483320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.483456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.483598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.483821 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.484023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.484744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.484961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.485170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.485399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.485614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.485834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.485834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.486259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.486462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.486686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.486908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.487131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.487343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.487570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.487837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.488069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.488291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.488514 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.488689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.488829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.488968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.489104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.489240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.489240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.489492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.489814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.490896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.491089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.491219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.491353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.491479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.491856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.492880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493134 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.493931 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494073 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.494980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495514 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.495795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.496982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.497248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.497394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.497530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.497658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.497852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.497985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.498166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.498305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.498476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.498606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.498787 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.498933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.499091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.499218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.499392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.499533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.499761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.500441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.500639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.500767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.500895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.501040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.501209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.501340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.501524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.501654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.501941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.502171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.502393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.502525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.502525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.502765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.502893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.503952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504215 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504478 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504617 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.504915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.505102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.505318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.505526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.505761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.505980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.506202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.506414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.506628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.506858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.507102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.507102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.507510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.507751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.507963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.508193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.508426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.508655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.508867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.509080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.509247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.509393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.509530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.509660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.509788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.510009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.510141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.510380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.510512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.510658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.510854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.511064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.511194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.511194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.511454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.511662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.511808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.512096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.512283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.512435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.512435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.512773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.512923 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.513763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514414 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.514943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.515939 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.516999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.517136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.517271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.517405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.517532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.517765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.517897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518033 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.518945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519773 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.519901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520636 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.520974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.521251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.521380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.521506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.521632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.521765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.521900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.522034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.522299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.522438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.522573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.522793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.522990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.523986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.524916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.525052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.525230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.525457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.525666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.525870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.526079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.526289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.526501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.526733 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.526944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.527149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.527359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.527642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.527869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.528103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.528328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.528540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.528751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.528964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.529188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.529325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.529554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.529554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.529798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.529932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.530069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.530212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.530531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.530722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.530842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.531081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.531290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.531423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.531550 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.531776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.531904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.532049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.532377 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.532520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.532649 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.532797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.533796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.534981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535654 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.535913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.536849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.537953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.538996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.539123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.539256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.539382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.539588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.539784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.539921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.540051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.540178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.540311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.540445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:55:52.540660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.540660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.540914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.541050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.541365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.541679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.541991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.542311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.542625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.542938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.543272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.543777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.544107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.544431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.544752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.545067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.545388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.545718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.546031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.546362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.547197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.547534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.547894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.548223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.548524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.548844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.549187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.549456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.549764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.550116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.551642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.551642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.551642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.551642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.552176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.552691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.552870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.553185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.553522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.553859 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.554177 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.554492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.554812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.555127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.555443 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.555791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.556113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.556424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.556738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.557050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.557379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.557697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.559668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.559668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.559668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.559668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.559668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.560376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.560376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.560376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.560777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.560984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.561326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.561638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.561968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.562368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.563190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.563528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.563528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.563528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.567741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.568220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.568220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.568220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.569250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.569250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.569250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.569495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.570088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.570088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.570311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.570645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.570991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.571335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.571685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.572014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.572340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.572664 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.573097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.573431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.573747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.574071 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.574396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.574781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.575040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.575349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.575690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.576014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.576336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.576653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.576973 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.577292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.577622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.577991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.578320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.578643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.578964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.579286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.579861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.580432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.580777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.581112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.581441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.581766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.582106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.582439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.582753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.583061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.583387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.583731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.584053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.584384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.584705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.585019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.585348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.585664 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.586207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.586667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.587087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.587423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.587783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.588114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.588431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.588763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.589080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.589396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.589722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.590041 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.590355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.590669 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.590996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.591309 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.591652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.591959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.592271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.592606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.593092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.593424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.593766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.594088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.594401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.594714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.595031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.595343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.595683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.595998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.596317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.596632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.596952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.597266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.597587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.597899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.598231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.598546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.598858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.599183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.599506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.599869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.600194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.600522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.600879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.601205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.601749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.602153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.602488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.603102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.603460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.603800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.604123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.604446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.604782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.605106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.605431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.605759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.606284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.606619 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.606959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.607270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.607592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.607936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.608290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.608619 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.608948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.609809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.610136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.610456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.610774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.611096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.611412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.611760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.612099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.612423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.612737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.613170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.613495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.613830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.614163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.614486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.614820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.615152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.615475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.615830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.616156 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.616512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.616847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.617185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.617520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.617849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.618150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.618465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.618785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.619128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.619454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.619812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.620137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.620474 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.620795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.621125 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.621459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.621786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.622107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.622445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.622760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.623281 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.623391 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.623725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.624048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.624373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.624706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.625600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.625916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.626250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.626576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.626911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.627415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.627772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.628115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.628436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.628763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.629084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.629405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.629730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.630056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.630390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.630724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.631057 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.631392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.631770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.631886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.context [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37efc4e6-05c3-46b6-81a9-5d64f9690a41(cell1) {{(pid=115446) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 04:55:52.632095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.632448 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.632784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.633106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.633428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.633745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:55:52.633995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:55:52.636025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:55:52.637627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:55:52.638437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:55:52.640620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:55:52.651463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:52.652163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:52.657175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:52.724735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.context [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37efc4e6-05c3-46b6-81a9-5d64f9690a41(cell1) {{(pid=115445) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 04:55:52.729112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:55:52.730712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:55:52.731522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:55:52.733651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:55:52.744941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:52.746451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:52.954323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:53.012149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:55:53.323070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:55:53.331233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:55:53.350200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: WARNING keystonemiddleware.auth_token [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:55:53.357419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: WARNING keystonemiddleware.auth_token [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:55:53.703099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:55:53.709338 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-3181a887-d542-4af3-a4ef-9704318c5207 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:55:53.713811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: WARNING keystonemiddleware.auth_token [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 04:55:53.714517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c9d9299c0 pid: 115446 (default app) Nov 09 04:55:53.720640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: WARNING keystonemiddleware.auth_token [None req-f8d2e191-2b66-451d-84ba-bff2843f6164 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 04:55:53.725763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c9d9299c0 pid: 115445 (default app) Nov 09 04:56:27.875979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-840207914", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "9dc74574-bcbe-4d7d-85c6-61611faf1df6"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:28.050018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8be24ea1-5e4b-4669-a5a1-dffa0aa4d437 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Action: 'create', calling method: .version_select at 0x7f30cde10280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-625344672", "metadata": {"Type": "work"}}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:29.049977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] validate_networks() for [('9dc74574-bcbe-4d7d-85c6-61611faf1df6', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:56:30.327702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8be24ea1-5e4b-4669-a5a1-dffa0aa4d437 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.320498 Nov 09 04:56:30.328635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 9 04:56:27 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3323 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 09 04:56:30.341758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7b59bfe8-312a-4cd7-8567-26c90eee7f81 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Calling method '.version_select at 0x7f30cdcc1e50>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:30.469454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7b59bfe8-312a-4cd7-8567-26c90eee7f81 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3" status: 200 len: 352 microversion: 2.1 time: 0.132576 Nov 09 04:56:30.470141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 2/2] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 04:56:30 2021] GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:56:31.187596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:56:31.188185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:56:31.188780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:56:31.189288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:56:31.189735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:56:31.222896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:31.223490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:31.224348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:31.226355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:31.328611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:31.340032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for user 2dc41f90272e4a549aad1634f08342a6 and project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:31.374250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:56:31.380867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:56:31.546602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f588e51f-1533-4170-89d1-e1e71f2bcfa8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.961622 Nov 09 04:56:31.547800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:56:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 4965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:56:31.552653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2f4e3d25-983c-49e0-82ef-6fc2a2d447f7 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Calling method '.version_select at 0x7f30cd3f7c10>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:31.575734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1099151968", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "19d7125c-22b1-4e83-a8ec-8b58c6b76394"}]}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:31.809393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] validate_networks() for [('19d7125c-22b1-4e83-a8ec-8b58c6b76394', None, None, None, None, None)] {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:56:32.025723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2f4e3d25-983c-49e0-82ef-6fc2a2d447f7 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3" status: 200 len: 353 microversion: 2.1 time: 0.477046 Nov 09 04:56:32.027210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 04:56:31 2021] GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 => generated 353 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:56:32.033652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3642d258-a58a-4acd-9773-4e66cb18e2a2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:32.037238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3642d258-a58a-4acd-9773-4e66cb18e2a2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:32.194617 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3642d258-a58a-4acd-9773-4e66cb18e2a2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:32.220341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3642d258-a58a-4acd-9773-4e66cb18e2a2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1217 microversion: 2.1 time: 0.191304 Nov 09 04:56:32.225375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 3/5] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:32 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:32.230732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2f338ccb-dc57-4279-8a99-1d839b48a936 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Calling method '.version_select at 0x7f30ccb950d0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:32.343303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2f338ccb-dc57-4279-8a99-1d839b48a936 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3" status: 200 len: 353 microversion: 2.1 time: 0.116004 Nov 09 04:56:32.346055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 4/6] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 04:56:32 2021] GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:56:32.367336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ef461fb8-9655-4234-8c03-d1775721c2ff tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Calling method '.version_select at 0x7f30ccb85f70>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:32.505175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ef461fb8-9655-4234-8c03-d1775721c2ff tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3" status: 202 len: 0 microversion: 2.1 time: 0.147008 Nov 09 04:56:32.508533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 5/7] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 9 04:56:32 2021] DELETE /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:56:32.513956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-51270045-e87b-4abd-ac9a-75f7b17a352d tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Calling method '.version_select at 0x7f30ccb27280>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:32.589352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-51270045-e87b-4abd-ac9a-75f7b17a352d tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3" status: 200 len: 352 microversion: 2.1 time: 0.079382 Nov 09 04:56:32.589927 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 6/8] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 04:56:32 2021] GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:56:33.242795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d70592f7-f2b2-40c3-a334-df7125ea7d76 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:33.243458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d70592f7-f2b2-40c3-a334-df7125ea7d76 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:33.486335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d70592f7-f2b2-40c3-a334-df7125ea7d76 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:33.497950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d70592f7-f2b2-40c3-a334-df7125ea7d76 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1217 microversion: 2.1 time: 0.259814 Nov 09 04:56:33.504769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 7/9] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:33 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:33.602249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e57d26a5-34d8-4e35-af6b-6ea250e5e1f3 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Calling method '.version_select at 0x7f30ccb953a0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:33.669298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-e57d26a5-34d8-4e35-af6b-6ea250e5e1f3 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] HTTP exception thrown: Volume f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 could not be found. Nov 09 04:56:33.670158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e57d26a5-34d8-4e35-af6b-6ea250e5e1f3 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] Returning 404 to user: Volume f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:56:33.671140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e57d26a5-34d8-4e35-af6b-6ea250e5e1f3 tempest-VolumesGetTestJSON-880011126 tempest-VolumesGetTestJSON-880011126-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3" status: 404 len: 109 microversion: 2.1 time: 0.073219 Nov 09 04:56:33.671740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 8/10] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 04:56:33 2021] GET /compute/v2.1/os-volumes/f50d57d6-6ced-4c33-b2d9-d1c61503ebd3 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 04:56:33.893249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:56:33.900445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:56:33.900949 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:56:33.901461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:56:33.901817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:56:33.973460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:33.978382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:33.980727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:33.981187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:34.093790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Getting quotas for project 27238c465f3941fb932e099dca430763. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:34.103906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Getting quotas for user 592dc580513e4330b1e64575920f0a8e and project 27238c465f3941fb932e099dca430763. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:34.122480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:56:34.128430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:56:34.293810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-53a2f965-7d17-4026-a3f6-8bdc72d220fc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.204666 Nov 09 04:56:34.299558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 3/11] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:56:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 3209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:56:34.305462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0fba126-fbae-4b37-9e7f-ce0686fc0226 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:34.308182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0fba126-fbae-4b37-9e7f-ce0686fc0226 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:34.522231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:34.522854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:34.545916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:34.546277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:34.547076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:34.547509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:34.663790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d0fba126-fbae-4b37-9e7f-ce0686fc0226 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:34.680970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0fba126-fbae-4b37-9e7f-ce0686fc0226 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1215 microversion: 2.1 time: 0.379413 Nov 09 04:56:34.685333 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 9/12] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:34 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1215 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:35.405242 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:35.436507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d87154c6-21ff-4aac-af3e-802e21b4ab33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1269 microversion: 2.1 time: 0.918148 Nov 09 04:56:35.438324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 4/13] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:34 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1269 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:35.698289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f6ecb22-a065-48cc-86c2-9abf0435f3f0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:35.699687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f6ecb22-a065-48cc-86c2-9abf0435f3f0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:35.902131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6f6ecb22-a065-48cc-86c2-9abf0435f3f0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:35.912802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f6ecb22-a065-48cc-86c2-9abf0435f3f0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1215 microversion: 2.1 time: 0.218176 Nov 09 04:56:35.918670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 10/14] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:35 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:36.456693 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:36.457873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:36.471961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:36.473258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:36.474165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:36.476740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:36.818319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:36.828446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7b6ca252-8ef4-4387-b20d-7233097362c5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1269 microversion: 2.1 time: 0.377550 Nov 09 04:56:36.829044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 5/15] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:36 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1269 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:36.929971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:36.930578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:36.948285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:36.948978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:36.954852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:36.955605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:37.312105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:37.332481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76214d73-6510-475a-a98b-8b3035bdab0a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1219 microversion: 2.1 time: 0.406612 Nov 09 04:56:37.335460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 11/16] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:36 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1219 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:37.845993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:37.846873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:37.865242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:37.865951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:37.867477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:37.868195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:38.010851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:38.025775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2ec04309-beea-4744-a547-da3ba896b253 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1269 microversion: 2.1 time: 0.182493 Nov 09 04:56:38.025775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 12/17] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:37 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:38.190860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-838115472", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb813874-3a1c-46ff-b91a-7dd6ea1c233b"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:38.202884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-858c816c-7f56-45b7-833b-cf68a00cf243 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'create', calling method: .version_select at 0x7f30cd365ca0>, body: {"keypair": {"name": "tempest-keypair-235842644"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:38.245954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-858c816c-7f56-45b7-833b-cf68a00cf243 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:38.256164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-858c816c-7f56-45b7-833b-cf68a00cf243 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for user 115a975a272c4ad9a5e93a38ee1c8180 and project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:38.282851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] validate_networks() for [('eb813874-3a1c-46ff-b91a-7dd6ea1c233b', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:56:38.630238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-858c816c-7f56-45b7-833b-cf68a00cf243 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:38.638606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-858c816c-7f56-45b7-833b-cf68a00cf243 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for user 115a975a272c4ad9a5e93a38ee1c8180 and project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:38.674731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-858c816c-7f56-45b7-833b-cf68a00cf243 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.058822 Nov 09 04:56:38.676311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 6/18] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Nov 9 04:56:37 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1061 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 09 04:56:38.681360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:38.695092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:38.718329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:38.719123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:38.722371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:38.723505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:38.957551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:38.965685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-00e611b2-c55e-4c3a-9b36-052aabb8cdd6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1219 microversion: 2.1 time: 0.288094 Nov 09 04:56:38.966270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 7/19] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:38 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1219 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:39.049690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:39.050313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:39.103431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:39.113756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:39.117368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:39.120542 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:39.323439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:39.333471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ea3e6431-4b81-4e37-80ec-f45936f14c0d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1269 microversion: 2.1 time: 0.289396 Nov 09 04:56:39.347735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 8/20] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:39 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:39.352791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:56:39.353313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:56:39.353670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:56:39.354330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:56:39.354951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:56:39.369759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:39.372390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:39.373893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:39.376433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:39.443420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Getting quotas for project 03305e25979a4de2b9bf721e0ac9fabe. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:39.455876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Getting quotas for user d77e7d6b09ac482f8bf1bcf4c83ed05e and project 03305e25979a4de2b9bf721e0ac9fabe. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:39.504706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:56:39.509078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:56:39.654370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5df5c6c4-a368-4f71-8e8d-9139fb72511e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.570536 Nov 09 04:56:39.659072 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 13/21] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:56:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:56:39.670757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-03d62409-982b-417b-836f-2031a9e45fc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:39.671667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-03d62409-982b-417b-836f-2031a9e45fc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:39.834020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-03d62409-982b-417b-836f-2031a9e45fc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:39.855536 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-03d62409-982b-417b-836f-2031a9e45fc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1221 microversion: 2.1 time: 0.190197 Nov 09 04:56:39.859430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 9/22] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:39.982548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:39.983098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:39.999894 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:40.000406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:40.008822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:40.009660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:40.354149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:40.354963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:40.393231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:40.393231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:40.393231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:40.393231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:40.521217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:40.538063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7bcbd9a4-8d5e-4435-9ce4-3c2c5e692f40 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1267 microversion: 2.1 time: 0.555769 Nov 09 04:56:40.551477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 14/23] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:39 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1267 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:40.569385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-793079114", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb813874-3a1c-46ff-b91a-7dd6ea1c233b"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:40.706172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] validate_networks() for [('eb813874-3a1c-46ff-b91a-7dd6ea1c233b', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:56:40.843163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:40.858371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a41c6b9a-4bd2-4539-9e73-5cb20edde277 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1275 microversion: 2.1 time: 0.503638 Nov 09 04:56:40.870801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 10/24] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:40 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1275 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:41.556960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:41.558213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:41.571136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:41.573239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:41.574848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:41.582548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:41.843581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:41.863190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-407c1b61-727b-4bf8-a25e-f5633a02bb8e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1273 microversion: 2.1 time: 0.308381 Nov 09 04:56:41.864016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 11/25] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:41 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:41.895533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:41.901830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:41.928479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:41.939034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:41.945657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:41.946278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:42.350110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:42.363513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4cd0ff74-d4ae-441b-9bfe-8d6fdcd49229 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1275 microversion: 2.1 time: 0.488054 Nov 09 04:56:42.367187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 12/26] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:41 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1275 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:42.888617 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:42.890576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:42.910563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:42.911425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:42.912713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:42.914301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:43.282484 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:43.304291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2a714cfd-cc8a-4f91-85d9-e485cd2f6c6b tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1273 microversion: 2.1 time: 0.406203 Nov 09 04:56:43.305334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 13/27] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:42 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1273 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:43.384970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:43.385384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:43.409278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:43.410976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:43.412852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:43.417333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:44.400360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:56:44.400975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:56:44.401244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:56:44.401651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:56:44.402059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:56:44.419428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:44.420789 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:44.421820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:44.422414 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:44.451516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Getting quotas for project 03305e25979a4de2b9bf721e0ac9fabe. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:44.456389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Getting quotas for user d77e7d6b09ac482f8bf1bcf4c83ed05e and project 03305e25979a4de2b9bf721e0ac9fabe. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:44.471807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:56:44.474298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:56:44.559010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9d731937-d3d4-46f3-b634-245bfda39a30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.996767 Nov 09 04:56:44.560459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 15/28] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:56:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 4008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:56:44.570578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:44.578768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-badd5339-be3d-41da-a60b-05ffb6b76821 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 1.198826 Nov 09 04:56:44.581143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:44.587415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 14/29] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:43 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:44.594499 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-330a4ff1-bed2-493d-a6df-742068e90e8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:44.595571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-330a4ff1-bed2-493d-a6df-742068e90e8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:44.598548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:44.611422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:44.611926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:44.612718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:44.613777 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:44.798815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:44.803992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-330a4ff1-bed2-493d-a6df-742068e90e8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:44.807638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b83cf33d-2919-4ec4-a05c-40beca58f787 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1273 microversion: 2.1 time: 0.245475 Nov 09 04:56:44.808745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 16/30] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:44 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:44.813355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-330a4ff1-bed2-493d-a6df-742068e90e8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1221 microversion: 2.1 time: 0.224186 Nov 09 04:56:44.814917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 15/31] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:44 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1221 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:45.481029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1527003180", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c60fd891-87b5-46cd-8c22-d608e60c1a68"}], "security_groups": [{"name": "tempest-securitygroup--2126910845"}], "key_name": "tempest-keypair-235842644", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:56:45.591203 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] validate_networks() for [('c60fd891-87b5-46cd-8c22-d608e60c1a68', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:56:45.603556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:45.604210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:45.609958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:45.610407 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:45.611347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:45.611961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:45.800296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:45.818737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f6c66245-521a-480e-84ce-a171cc008e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.216137 Nov 09 04:56:45.819470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 16/32] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:45 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:45.842358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:45.843021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:45.861713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:45.864110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:45.865692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:45.865692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.070519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:56:46.070519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:56:46.070519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:56:46.071999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:56:46.072704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:56:46.081778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:46.082218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.083333 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:46.083792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.098831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:46.104315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for project df921510edf34ac09f5be957837f5546. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:56:46.109566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for user 115a975a272c4ad9a5e93a38ee1c8180 and project df921510edf34ac09f5be957837f5546. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:56:46.111156 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2e44c3ae-7832-445c-9ca0-ea77779d095f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.280219 Nov 09 04:56:46.112787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 17/33] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:45 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:46.118217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:46.119590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:46.128803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:46.129250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.130031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:46.130466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.133784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:56:46.136189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:56:46.192406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7521b418-66ed-4f55-afd0-1bb8ab68621c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.715546 Nov 09 04:56:46.193368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 17/34] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Nov 9 04:56:45 2021] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 09 04:56:46.203012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3b0655d9-20d7-481f-af3f-9260aab1026b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:46.204060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3b0655d9-20d7-481f-af3f-9260aab1026b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:46.221226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:46.229331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8c6b901b-968f-4430-a03c-d46197df672b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.115280 Nov 09 04:56:46.239533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 18/35] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:46 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:46.272181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3b0655d9-20d7-481f-af3f-9260aab1026b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:46.281634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3b0655d9-20d7-481f-af3f-9260aab1026b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:46.283694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3b0655d9-20d7-481f-af3f-9260aab1026b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:46.284977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3b0655d9-20d7-481f-af3f-9260aab1026b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1281 microversion: 2.20 time: 0.085923 Nov 09 04:56:46.285612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 18/36] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:46 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:56:46.835888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:46.836457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:46.843145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:46.843600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.844435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:46.844870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:46.990830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:46.998707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-803b8071-ce94-4d03-8115-ddee2de1f612 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.166761 Nov 09 04:56:46.999488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 19/37] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:46 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:47.129445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:47.130343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:47.139142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:47.139816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:47.140587 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:47.141016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:47.245692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:47.246301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:47.253722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:47.254678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:47.256381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:47.257219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:47.303133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:47.313317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-55cb5559-9709-484b-88f5-693be2f79f8c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.186511 Nov 09 04:56:47.314976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 19/38] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:47 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:47.326812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:47.328478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:47.333965 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:47.335456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:47.335960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:47.336747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:47.337183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:47.342556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-801c8ad8-695c-4640-bd5f-808267709362 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.099756 Nov 09 04:56:47.343909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 20/39] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:47 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:47.402349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:47.410403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:47.411917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:47.413000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f4abfc4a-e908-40b9-b188-64b2467c628d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.096038 Nov 09 04:56:47.413553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 20/40] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:47 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:48.016839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:48.017486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:48.023361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.023854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.024644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.025352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.171322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:48.180095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c4f75024-ccff-4958-bf04-6fe3a6c06efd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.167648 Nov 09 04:56:48.180704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 21/41] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:48 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:48.336338 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:48.337024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:48.342986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.343332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.344290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.344731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.360299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:48.360916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:48.372140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.372853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.374482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.375072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.447802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:48.456366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-84f49e72-d7a9-4336-a046-a0957e14f281 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.100563 Nov 09 04:56:48.457163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 22/42] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:48 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:48.462459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:48.463289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:48.469595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.470081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.470923 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:48.471361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:48.523694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:48.531074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c82c2c5f-f38b-42c1-b395-f85b19ba399a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.198365 Nov 09 04:56:48.531773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 21/43] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:48 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:48.534661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:48.542558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:48.544104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:48.545226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-138e65d9-df21-4a44-a302-2336cc0bcf0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.087003 Nov 09 04:56:48.545772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:48 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:49.195939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:49.196484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:49.202292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.202731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.203480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.203932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.348987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:49.356793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d2ebf52d-a015-49c7-949e-2337449aad0a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.164554 Nov 09 04:56:49.357975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 22/45] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:49 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:49.474538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:49.475231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:49.481328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.481782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.483080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.483516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.547323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:49.548655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:49.549496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:49.556126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.556822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.557901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.558556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.562584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b821934a-2e48-4bc0-b886-5d6d60f1de0d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.091819 Nov 09 04:56:49.564174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 24/46] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:49 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:49.571695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:49.572319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:49.580480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.581029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.581889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:49.582399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:49.651523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:49.667517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:49.669193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:49.671128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-35eb91b3-cfd8-4a04-8c39-2719884e622f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.105680 Nov 09 04:56:49.671590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 25/47] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:49 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:49.717564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:49.724926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c193ea8-732a-45e3-b619-c0ded5e6d25e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.180555 Nov 09 04:56:49.725528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 23/48] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:49 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:50.377814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:50.378425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:50.384868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.385326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.386107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.386877 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.526107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:50.559942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-be4649d7-9f86-4969-b739-430245cf93a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.186184 Nov 09 04:56:50.572357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 26/49] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:50 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:50.585873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:50.586744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:50.593158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.593675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.594708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.595337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.673923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:50.685835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f0f4ee47-927e-4b93-a77c-28aa0d8907e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.109211 Nov 09 04:56:50.686695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 24/50] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:50 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:50.689433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:50.690205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:50.697204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.697705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.698496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.698925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.742571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:50.743486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:50.749841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.750365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.751244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:50.751704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:50.791955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:50.802658 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:50.804874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:50.806190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-feab785e-bfdf-4023-b5cc-d27ab3196677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.121439 Nov 09 04:56:50.806989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 27/51] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:50 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:56:50.899381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:50.908354 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-88b57063-a3c2-4c22-83fb-6ee1094532fd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.169443 Nov 09 04:56:50.909182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 25/52] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:50 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:51.592354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:51.592959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:51.611197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.611681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.612645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.613089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.703386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:51.704126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:51.710758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.711346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.712017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.712452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.809410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:51.820694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0ec9b03d-f45f-451a-b760-04b39b5d375d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.230818 Nov 09 04:56:51.820694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 28/53] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:51 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:51.836751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:51.837036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:51.837817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:51.844676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-71ba6d83-c0b7-48a7-b016-329d0c096c76 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.145865 Nov 09 04:56:51.845841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 26/54] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:51 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:51.853462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.853938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.854756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.855192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.929096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:51.929865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:51.938439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.941841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.943249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:51.945436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:51.979648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:51.992438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:51.996319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:52.001422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5e694025-a833-41d2-ad46-c7a5eb66d272 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.169670 Nov 09 04:56:52.002402 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 29/55] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:51 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:52.244737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:52.260192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-09562aa4-db3c-4962-b7d9-6ca91ca7d0aa tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.335491 Nov 09 04:56:52.261301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 27/56] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:51 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:52.837334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:52.837944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:52.844540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:52.844993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:52.846205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:52.846803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:52.862764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:52.865714 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:52.871937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:52.873718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:52.875243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:52.875698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:52.965904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:52.974822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-64c988cf-15ab-4e79-ad16-58f2ab6ef696 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.116088 Nov 09 04:56:52.975668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 28/57] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:52 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:53.020369 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:53.020978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:53.030378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:53.030857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:53.031694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:53.032132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:53.070095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:53.079454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-86974dac-b601-4fcf-a9cf-11fc8bab6599 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.245694 Nov 09 04:56:53.083775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 30/58] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:52 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:53.151530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:53.161152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:53.162956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:53.164749 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3ea5985b-102a-43f0-a30c-a4fcadde5f07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.147615 Nov 09 04:56:53.165954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 29/59] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:53 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:53.279201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:53.279841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:53.288348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:53.288842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:53.300460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:53.300913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:53.675731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:53.686237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f7d28dae-f174-4e35-ab64-ecb248508892 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.411729 Nov 09 04:56:53.698316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 31/60] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:53 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:53.993911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:53.996578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:54.010580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.011681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.012805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.013458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.081919 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:54.089280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d3eaeb6b-2023-4b5e-90a4-7266673a14a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.100536 Nov 09 04:56:54.105543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:54.106791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:54.112426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 30/61] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:53 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:54.130585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.131378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.132366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.132947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.188821 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:54.189716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:54.201546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.202004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.203165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.203612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.310516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:54.311576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:54.327045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f9430045-bc9d-4a4e-8075-20a5215b8e3c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.224937 Nov 09 04:56:54.329051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 32/62] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:54 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:54.332978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:54.334492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:54.335593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8e8f19cd-1e2d-46cf-9bed-cd50b93d29b1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.154584 Nov 09 04:56:54.336342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 31/63] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:54 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:54.706928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:54.712506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:54.720297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.720886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.721950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:54.722380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:54.966825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:54.979247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-42b84f33-20c8-4acc-be0a-a53cea059e8f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.277416 Nov 09 04:56:54.989901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 33/64] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:54 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:55.113963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:55.116066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:55.130601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:55.133934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:55.135503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:55.138310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:55.261180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:55.271097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-72c249e7-f941-4227-a844-a3857111edeb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.166797 Nov 09 04:56:55.277340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 32/65] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:55 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:55.348310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:55.349559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:55.353991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:55.354585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:55.357579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:55.359878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:55.360977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:55.361740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:55.364301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:55.364574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:55.365568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:55.366484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:55.485901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:55.498229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:55.500048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:55.501303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-692ea139-00e9-42eb-a7d8-9d9dcdeba667 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.150970 Nov 09 04:56:55.503252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 33/66] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:55 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:55.551395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:55.560396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5375819b-8aad-4123-a418-13177cc329e3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.215631 Nov 09 04:56:55.561200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 34/67] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:55 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:55.996845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:55.997889 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:56.011989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.013352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.015569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.016913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.260192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:56.270623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3183280f-c52a-470a-bfd5-c21545acf2bd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.275245 Nov 09 04:56:56.284148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 34/68] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:55 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:56.297145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:56.298065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:56.316191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.317971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.320062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.323926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.409039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:56.418241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b78b14e9-712b-4c92-90ac-5fd55ea797d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.126132 Nov 09 04:56:56.418821 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 35/69] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:56 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:56.523078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:56.525160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:56.537147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.537965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.538892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.539461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.578414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:56.578985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:56.591704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.592120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.602056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:56.603110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:56.689718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:56.697445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:56.703861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:56.712576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7e3a5e6b-34dc-4360-96b7-2465eeab0638 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.192952 Nov 09 04:56:56.714816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 35/70] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:56 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:56.920153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:56.935101 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1c0f5b76-8a4f-4a8a-bf10-1ea0140dcecd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.358827 Nov 09 04:56:56.937130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 36/71] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:56 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:57.289717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:57.291487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:57.316607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.317050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.317828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.318252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.438412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:57.439028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:57.452867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.453648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.454769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.455614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.552025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:57.578267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-98d08beb-791d-49f6-8da9-6d7d00bd3660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.145509 Nov 09 04:56:57.589205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 37/72] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:57 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:57.645707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:57.653561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-871df119-9809-4b5f-9397-f28d67616a75 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.367457 Nov 09 04:56:57.655969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 36/73] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:57 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:57.733949 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:57.735158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:57.741442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.742134 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.742924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.746996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.810258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:57.818779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:57.820390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:57.821577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d4d91d4e-2fe7-489c-a99c-86560adf1bfa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.092268 Nov 09 04:56:57.822210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:57 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:57.956370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:57.958535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:57.965842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.966568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:57.967446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:57.968601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.130798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:58.144198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bb451498-6174-4748-ba63-25c052bf803f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.193483 Nov 09 04:56:58.155067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 37/75] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:57 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:58.596471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:58.597185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:58.605085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:58.605555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.606649 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:58.607249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.671498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:58.672965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:58.679316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:58.680060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.681065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:58.681711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.690409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:58.698147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-789f83d4-73ce-4cbc-a978-c77490aeb63e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1225 microversion: 2.1 time: 0.105488 Nov 09 04:56:58.708076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 39/76] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:58 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:58.824718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:58.834416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e91d9dff-afca-47b9-b373-d86483485865 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.167892 Nov 09 04:56:58.835520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 38/77] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:58 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:56:58.839916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:58.840527 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:58.847749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:58.848255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.849090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:58.849467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:58.912020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:58.920148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:58.921689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:58.923148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5216e853-c554-493c-b386-de78a6783e8a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1285 microversion: 2.20 time: 0.087204 Nov 09 04:56:58.923720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 40/78] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:58 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:56:59.162646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:59.163371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:59.170121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.170666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.171966 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.172992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.345906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:59.362082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-af9fc636-df92-409a-9957-4c6c322c18db tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.204495 Nov 09 04:56:59.363925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 39/79] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:59 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:59.715261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:59.715891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:59.726184 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.726566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.727350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.727832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.852083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:59.852938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:59.863055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.863522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.864334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.864773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.908188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:56:59.917321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e197a286-5c40-472f-938c-925a7b1c8761 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1273 microversion: 2.1 time: 0.205665 Nov 09 04:56:59.917944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 41/80] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:59 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:56:59.941688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:56:59.942613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:56:59.955115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.957260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:56:59.959253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:56:59.960104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:00.191091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:00.201462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-41478290-1039-4274-a2a8-ddee072c954e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.352934 Nov 09 04:57:00.205100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 40/81] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:56:59 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:00.380257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:00.381086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:00.393118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:00.393762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:00.394581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:00.395017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:00.762516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:00.773121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:00.784830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:00.786052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f2244868-06ce-4764-84d8-1acbc571e5aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1277 microversion: 2.20 time: 0.848248 Nov 09 04:57:00.797618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 42/82] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:56:59 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1277 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:00.949181 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:00.949791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:00.956425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:00.956873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:00.957653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:00.958084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.202105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:01.207393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-98031571-417a-42d8-a82c-ea3eb38ec3d6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.830760 Nov 09 04:57:01.214168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 41/83] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:00 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:01.221978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:01.223030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:01.235852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.236299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.237274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.237978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.287712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:01.298185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4d83059e-082c-474d-9218-1f25a551789e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1279 microversion: 2.1 time: 0.352515 Nov 09 04:57:01.299953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 43/84] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:00 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:01.715839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-48c0ee43-3578-4227-84b0-d35ffd7f200c req-ba556e48-b8ca-47db-94ca-0ba6691e2ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a87e643-d686-4a9b-b027-d72b89ab2e12", "tag": "d6b95a2c-0b66-4503-93bb-c3d25b0b0db8"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:01.719046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:01.719046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:01.730632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-48c0ee43-3578-4227-84b0-d35ffd7f200c req-ba556e48-b8ca-47db-94ca-0ba6691e2ce1 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.731296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-48c0ee43-3578-4227-84b0-d35ffd7f200c req-ba556e48-b8ca-47db-94ca-0ba6691e2ce1 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.765795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-48c0ee43-3578-4227-84b0-d35ffd7f200c req-ba556e48-b8ca-47db-94ca-0ba6691e2ce1 service nova] Creating event network-changed:d6b95a2c-0b66-4503-93bb-c3d25b0b0db8 for instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 on hv-cinder-81713 Nov 09 04:57:01.767548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-48c0ee43-3578-4227-84b0-d35ffd7f200c req-ba556e48-b8ca-47db-94ca-0ba6691e2ce1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115445) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 04:57:01.769413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.771047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.772458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.773594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.788838 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.compute.rpcapi [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 09 04:57:01.789989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] Releasing lock "compute-rpcapi-router" {{(pid=115445) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 04:57:01.842555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8db960cc-2b64-4606-8f09-76fa60c7988b None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229329 Nov 09 04:57:01.843908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 44/85] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:01.854218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:01.854927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:01.863882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.864339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:01.865132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:01.865683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:02.004108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:02.019092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c838b79b-392b-4c34-a044-411de685600f tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.795351 Nov 09 04:57:02.020192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 42/86] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:01 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:02.082732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:02.100158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:02.107603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:02.109839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b817c8ea-04cc-4387-869e-7ffb4a9dd775 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1339 microversion: 2.20 time: 0.264808 Nov 09 04:57:02.113515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 45/87] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:01 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:02.224985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:02.225593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:02.232597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:02.233861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:02.234868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:02.235753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:02.362739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-2ed5f863-8820-461e-ab4b-f57b31167e92 req-da8e9910-d60d-425e-99ad-e26a4804b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e7964e-3c1d-4928-9dfa-399d3721c871", "tag": "e8784b0f-5ec8-4da9-b0e3-a4db5b8d59bf"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:02.368191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:02.368191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:02.377852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-2ed5f863-8820-461e-ab4b-f57b31167e92 req-da8e9910-d60d-425e-99ad-e26a4804b2f5 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:02.378421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-2ed5f863-8820-461e-ab4b-f57b31167e92 req-da8e9910-d60d-425e-99ad-e26a4804b2f5 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:02.395144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-2ed5f863-8820-461e-ab4b-f57b31167e92 req-da8e9910-d60d-425e-99ad-e26a4804b2f5 service nova] Creating event network-changed:e8784b0f-5ec8-4da9-b0e3-a4db5b8d59bf for instance 12e7964e-3c1d-4928-9dfa-399d3721c871 on hv-cinder-81713 Nov 09 04:57:02.401969 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-2ed5f863-8820-461e-ab4b-f57b31167e92 req-da8e9910-d60d-425e-99ad-e26a4804b2f5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143808 Nov 09 04:57:02.408365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 46/88] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:57:02.413863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:02.414558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:02.425390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:02.425834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:02.426622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:02.427061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:02.599375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:02.609682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b3cd960f-fb9f-45b5-9cca-b11127714618 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1279 microversion: 2.1 time: 0.199917 Nov 09 04:57:02.621993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 47/89] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:02 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:02.678329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:02.688436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-add74a84-1ab4-4295-9f02-c8f23e4ef1d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.465570 Nov 09 04:57:02.690202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 43/90] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:02 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:03.036789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:03.037979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:03.045254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.048801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.050816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.051417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.130244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:03.131195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:03.139300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.139967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.140851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.141385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.208243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:03.219548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:03.222007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:03.223653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5d6edb98-3748-4a75-9c73-34292c0609ad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1339 microversion: 2.20 time: 0.097178 Nov 09 04:57:03.224424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 44/91] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:03 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:03.628678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:03.629444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:03.650580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.651630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.652634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.653135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.917079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:03.921718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:03.940174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-90ad7846-a797-408d-8b40-e78eba56f480 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.905776 Nov 09 04:57:03.942153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 48/92] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:03 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:03.945227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f292d6dc-c3a8-42f7-834e-51acdc190dad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.316140 Nov 09 04:57:03.945982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 45/93] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:03 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:03.953290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:03.953991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:03.967277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.967885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:03.968755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:03.969270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.029322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-3237ea66-3900-4585-b787-89241697ce43 req-380b618c-2be7-42d2-a41e-449b248b13f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e4cb58-5dfa-445a-815e-30dcfaab94e9", "tag": "8e9494d2-6026-4da9-9838-657923b0d3c9"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:04.032094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:04.032094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:57:04.045587 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-3237ea66-3900-4585-b787-89241697ce43 req-380b618c-2be7-42d2-a41e-449b248b13f2 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.046733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-3237ea66-3900-4585-b787-89241697ce43 req-380b618c-2be7-42d2-a41e-449b248b13f2 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.071265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-3237ea66-3900-4585-b787-89241697ce43 req-380b618c-2be7-42d2-a41e-449b248b13f2 service nova] Creating event network-changed:8e9494d2-6026-4da9-9838-657923b0d3c9 for instance a2e4cb58-5dfa-445a-815e-30dcfaab94e9 on hv-cinder-81713 Nov 09 04:57:04.071833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-3237ea66-3900-4585-b787-89241697ce43 req-380b618c-2be7-42d2-a41e-449b248b13f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115446) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 04:57:04.073121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.073726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.074528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.074958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.086692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.compute.rpcapi [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 09 04:57:04.087586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] Releasing lock "compute-rpcapi-router" {{(pid=115446) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 04:57:04.129224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5ed97932-210f-4f10-924e-d3cb92322e60 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103650 Nov 09 04:57:04.129843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 46/94] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:57:04.244273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:04.245079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:04.260639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.261222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.261755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.262419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.593450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:04.602266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1fd9c4f7-5af7-4561-9ffd-82e208cc13fd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.658207 Nov 09 04:57:04.613228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 49/95] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:03 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:04.618921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-e6711968-870d-4803-aa36-4f3792616aa6 req-bb42a30f-74cb-4877-959a-d458dd893b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367541e4-c608-43b0-90da-677a42dc9b16", "tag": "4a887e80-10aa-4e62-9e15-7d3eb5cf25d5"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:04.620520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:04.620520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:04.628764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-e6711968-870d-4803-aa36-4f3792616aa6 req-bb42a30f-74cb-4877-959a-d458dd893b2d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.632116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-e6711968-870d-4803-aa36-4f3792616aa6 req-bb42a30f-74cb-4877-959a-d458dd893b2d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.633469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:04.646318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:04.658424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-e6711968-870d-4803-aa36-4f3792616aa6 req-bb42a30f-74cb-4877-959a-d458dd893b2d service nova] Creating event network-changed:4a887e80-10aa-4e62-9e15-7d3eb5cf25d5 for instance 367541e4-c608-43b0-90da-677a42dc9b16 on hv-cinder-81713 Nov 09 04:57:04.665873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:04.670413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-e6711968-870d-4803-aa36-4f3792616aa6 req-bb42a30f-74cb-4877-959a-d458dd893b2d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054828 Nov 09 04:57:04.672647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cbc83a11-ab35-47de-ae2f-e96cdfd94e75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.431427 Nov 09 04:57:04.673162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 50/96] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:04.684355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 47/97] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:04 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:04.959397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:04.967083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:04.968069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:04.970300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:04.986764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:04.991153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:04.995077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.005872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.009202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.009922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.015479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.016114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.534978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:05.543208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e7cde4c0-58e5-4d19-8ca5-0c95796982de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.581383 Nov 09 04:57:05.556684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 48/98] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:04 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:05.618905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:05.619518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:05.633673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.634255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.640591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.641049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.877557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:05.885674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7ba027cb-7d06-4377-b157-29122f6d449c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.270533 Nov 09 04:57:05.895831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 49/99] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:05 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:05.900805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:05.901607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:05.909231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.909895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.910825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:05.911392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:05.938714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:05.947743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-36391946-856b-4036-acc3-8054f015e734 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.993115 Nov 09 04:57:05.950287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 51/100] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:04 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:06.181767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:06.195084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:06.198192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:06.199712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-39dc02ab-33df-4b81-b6b9-262a24171abf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.302410 Nov 09 04:57:06.200486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 50/101] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:05 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:06.560904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:06.562062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:06.572604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.573114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:06.573819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.574979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:06.704853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-7c687dd1-4557-4509-b6b7-8568001b606d req-0bb48e16-e60e-4705-9145-7f3b5bb01175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034e3bd9-12b1-44b8-b263-15cd6de07fcd", "tag": "61b97e25-c60b-444c-aa5c-c81e5e096ded"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:06.707394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:06.707394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:57:06.717277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-7c687dd1-4557-4509-b6b7-8568001b606d req-0bb48e16-e60e-4705-9145-7f3b5bb01175 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.718909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-7c687dd1-4557-4509-b6b7-8568001b606d req-0bb48e16-e60e-4705-9145-7f3b5bb01175 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:06.734445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-7c687dd1-4557-4509-b6b7-8568001b606d req-0bb48e16-e60e-4705-9145-7f3b5bb01175 service nova] Creating event network-changed:61b97e25-c60b-444c-aa5c-c81e5e096ded for instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd on hv-cinder-81713 Nov 09 04:57:06.752225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-7c687dd1-4557-4509-b6b7-8568001b606d req-0bb48e16-e60e-4705-9145-7f3b5bb01175 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055222 Nov 09 04:57:06.766079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 51/102] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:06.904651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:06.904855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:06.905580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:06.912096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.912538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:06.913315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.913741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:06.921246 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f08c6eb5-dd47-47f7-9f8b-39f4a6820661 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.363666 Nov 09 04:57:06.924352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 52/103] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:06 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:06.966284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:06.967720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:06.974349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.975114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:06.976181 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:06.977385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:07.186741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:07.194426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e86cfb9f-ad70-4b42-9a6c-418c7360ebe4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.293425 Nov 09 04:57:07.195674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 52/104] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:06 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:07.218880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:07.219037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:07.219543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:07.228919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1e239de1-4585-40ae-b52a-f2e62158026d tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.266476 Nov 09 04:57:07.229086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:07.229475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:07.229837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 53/105] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:06 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:07.231021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:07.231475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:07.442561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:07.457864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:07.459852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:07.462065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c343d6a-f2ef-4629-b94c-36021f463ef5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.247591 Nov 09 04:57:07.463067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 53/106] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:07 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:07.941089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:07.942082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:07.950143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:07.950932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:07.953511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:07.957613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.099642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:08.117024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4eaf7841-a02b-4d77-9ed6-7a856c1f364f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.181693 Nov 09 04:57:08.126802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 54/107] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:07 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:08.211884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:08.212487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:08.218855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:08.219312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.220130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:08.220561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.246164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:08.246841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:08.254535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:08.255291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.256427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:08.257400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.381247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:08.388475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7842cd50-450d-43b3-8c75-1efc9447eeb7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.180171 Nov 09 04:57:08.397698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 54/108] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:08 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:08.429490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:08.438771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8d459365-5b73-490f-be3d-6345d68bf26a tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.196472 Nov 09 04:57:08.439371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 55/109] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:08 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:08.480524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:08.481224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:08.490871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:08.491329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.492145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:08.492564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:08.645581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:08.653980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:08.655469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:08.656594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f05ce899-5442-408a-976b-e6649dc47557 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.179922 Nov 09 04:57:08.657154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 55/110] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:08 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:09.133987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:09.134713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:09.140553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.140996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.142031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.142460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.297421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:09.305414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0aa483bf-9b28-4b7e-8196-de4936e2fd22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.174814 Nov 09 04:57:09.306091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 56/111] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:09 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:09.405970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:09.406575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:09.412835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.413282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.414049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.414478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.455559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:09.456196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:09.463488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.464333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.468484 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.469310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.634409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:09.641658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ea4cb840-b5c1-4bf0-a1f5-cb7af2c5b27f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.240013 Nov 09 04:57:09.642237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 56/112] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:09 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:09.674763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:09.675656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:09.682567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.683002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.684409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:09.685011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:09.807119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:09.814820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-878b43df-c73a-4455-a102-d5764a980c01 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.363187 Nov 09 04:57:09.815395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 57/113] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:09 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:09.871647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:09.879430 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:09.880981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:09.882082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-657900a4-af4c-499a-b043-63a244945b35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.211561 Nov 09 04:57:09.882639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 57/114] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:09 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:10.322472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:10.323080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:10.329602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.330056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.330846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.331283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.659131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:10.661459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:10.667679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.668129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.669260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.670002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.817236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:10.827462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-01997dc0-35e9-40ac-aead-9c814babf56f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.508433 Nov 09 04:57:10.847901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:10.854643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 58/115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:10 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:10.856116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1896cd00-c55b-4fbb-8d04-f5261f604ce6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.201463 Nov 09 04:57:10.856699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 58/116] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:10 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:10.860774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:10.861469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:10.867717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.868238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.869102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.869600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.903375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:10.904173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:10.910999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.911437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:10.912416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:10.912848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:11.057065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:11.075806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:11.078313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:11.079862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1874ab88-5d6f-4fdd-9ff7-ac65a96582c8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.183298 Nov 09 04:57:11.080640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 59/117] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:10 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:11.151756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:11.162041 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-65a6b81d-051f-4930-8642-8bf923a16b92 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.305698 Nov 09 04:57:11.163248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 59/118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:10 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:11.845202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:11.845798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:11.852032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:11.852459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:11.853241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:11.853711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:11.873155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:11.874860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:11.881564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:11.882223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:11.883311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:11.883986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:12.042762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:12.053769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c9b7c3e0-6e61-47c8-9b66-f78ff7f328ac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.212100 Nov 09 04:57:12.054953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 60/119] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:11 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:12.072932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:12.080643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8b8ad4aa-1df1-4076-8c57-43c60bdd421c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.210720 Nov 09 04:57:12.080998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 60/120] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:11 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:12.100106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:12.100699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:12.106515 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:12.106951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:12.107778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:12.108742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:12.178035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:12.178634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:12.184493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:12.184938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:12.185695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:12.186184 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:12.239960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:12.247680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:12.250457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:12.252285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7fe59d5c-5f4a-4a1f-9543-bf40036a6b79 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.155797 Nov 09 04:57:12.253196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 61/121] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:12 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:12.313749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:12.320898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cc273247-63a9-443c-9898-38632470d856 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.146583 Nov 09 04:57:12.321461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 61/122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:12 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:13.072878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:13.074152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:13.080412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.080858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.081634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.082235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.098422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:13.099030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:13.105038 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.105481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.106239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.106663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.208747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:13.215794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8989461d-ce2b-47ed-8830-2b5581712eee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.146662 Nov 09 04:57:13.216364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 62/123] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:13 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:13.236239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:13.243351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8081b3f4-7df5-4e02-ac18-8244f280b7e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.148523 Nov 09 04:57:13.243936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 62/124] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:13 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:13.271112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:13.271754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:13.277569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.278011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.278771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.279197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.337668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:13.338387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:13.344604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.345044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.345808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:13.346232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:13.412963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:13.421253 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:13.422726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:13.423829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a808b3e7-d5a8-4fec-85de-002d6e83bded tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.156477 Nov 09 04:57:13.424389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 63/125] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:13 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:13.473135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:13.480226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3e8e0e56-b51a-49f7-9923-9469d412a2c8 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.146213 Nov 09 04:57:13.480796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 63/126] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:13 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:14.233791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:14.234383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:14.240181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.240618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.241365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.241786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.261947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:14.262646 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:14.268312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.268756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.269586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.269950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.371615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:14.379423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a5fd2d73-2e3b-40ac-8531-462a622b35dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.150392 Nov 09 04:57:14.380020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 64/127] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:14 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:14.399679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:14.408808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d0cc7ae0-8917-4281-a5c7-6f8330eb0fab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.151163 Nov 09 04:57:14.409488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 64/128] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:14 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:14.441885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:14.442480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:14.448132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.448576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.449325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.449756 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.496371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:14.497068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:14.503318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.503862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.504694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:14.505193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:14.583581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:14.591374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:14.593446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:14.594537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-933a08ca-1380-493b-b46a-b9a2fc4f9018 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.156322 Nov 09 04:57:14.595096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 65/129] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:14 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:14.632323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:14.639825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9dc19306-2cef-4233-bb05-0713ac39a310 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.147017 Nov 09 04:57:14.640397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 65/130] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:14 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:15.396144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:15.396748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:15.402543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.402981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.403775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.404204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.425410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:15.426034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:15.431755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.432192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.432948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.433371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.529484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:15.536988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6b8271dc-343a-443d-80fd-6e4fdb2c795a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.144442 Nov 09 04:57:15.537556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 66/131] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:15 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:15.559252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:15.566951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dc5309bc-7e2f-473e-9d32-dc3d5bd9da1d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.145380 Nov 09 04:57:15.567509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 66/132] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:15 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:15.612321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:15.613061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:15.618980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.619427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.620235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.620669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.656255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:15.656783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:15.662888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.663334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.664131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:15.664590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:15.754278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:15.762711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:15.764482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:15.765516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-db23e723-a578-4973-a454-773b92fa7677 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.157097 Nov 09 04:57:15.766231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 67/133] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:15 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:15.805515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:15.813251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c28b98bb-eff5-4078-923c-a1f5db56e3a2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.160690 Nov 09 04:57:15.813827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 67/134] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:15 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:16.553497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:16.554014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:16.561618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.562067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.562838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.563271 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.583408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:16.584036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:16.589751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.590201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.590963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.591392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.695736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:16.704494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ffe76c6e-15ce-40ac-9cda-7e84c532b0fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.154627 Nov 09 04:57:16.705247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 68/135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:16 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:16.721312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:16.728442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-63fbf3bb-388e-4435-b4ef-32fdbb941b06 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.148702 Nov 09 04:57:16.728999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 68/136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:16 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:16.783133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:16.783768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:16.789529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.789979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.790749 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.791179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.830863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:16.831725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:16.838037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.838477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.839339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:16.839845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:16.918857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:16.926812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:16.928322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:16.929400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5c8eb0de-e105-43ce-83ad-4d710e3b9712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.150769 Nov 09 04:57:16.929960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 69/137] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:16 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:16.972095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:16.979138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6b30fcc9-0242-4430-8c6d-8ffd73af79f5 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.152934 Nov 09 04:57:16.979717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 69/138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:16 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:17.721620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:17.722119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:17.727970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:17.728409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:17.729164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:17.729591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:17.748568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:17.749028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:17.754996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:17.755437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:17.756404 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:17.756830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:17.890818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:17.898273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6c88b2e9-26e6-492d-93c5-88cb0313bd80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.180791 Nov 09 04:57:17.899314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 70/139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:17 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:17.919523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:17.928121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e7bbc6e9-b0f0-4898-aa28-8bce96255c93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.183814 Nov 09 04:57:17.929183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 70/140] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:17 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:17.949643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:17.950239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:17.957905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:17.958346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:17.959162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:17.959583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:17.998433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:17.999116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:18.005456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.005906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:18.006685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.007207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:18.172700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:18.185432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:18.188293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:18.189405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a829607c-4f9e-498a-8a39-60bb894b9cb5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.244692 Nov 09 04:57:18.195368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:18.204165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a2d833a8-5fc0-4394-916f-681d1d35ba97 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.212056 Nov 09 04:57:18.205820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 71/141] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:17 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:18.209194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 71/142] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:17 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:18.303869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-22c21a39-b9cd-45c5-bd36-46968cac39e6 req-86179444-5ab5-430a-86a4-49bcb62bff35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a87e643-d686-4a9b-b027-d72b89ab2e12", "name": "network-vif-plugged", "status": "completed", "tag": "d6b95a2c-0b66-4503-93bb-c3d25b0b0db8"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:18.305485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:18.305485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:18.314161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-22c21a39-b9cd-45c5-bd36-46968cac39e6 req-86179444-5ab5-430a-86a4-49bcb62bff35 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.314601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-22c21a39-b9cd-45c5-bd36-46968cac39e6 req-86179444-5ab5-430a-86a4-49bcb62bff35 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:18.327299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-22c21a39-b9cd-45c5-bd36-46968cac39e6 req-86179444-5ab5-430a-86a4-49bcb62bff35 service nova] Creating event network-vif-plugged:d6b95a2c-0b66-4503-93bb-c3d25b0b0db8 for instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 on hv-cinder-81713 Nov 09 04:57:18.334275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-22c21a39-b9cd-45c5-bd36-46968cac39e6 req-86179444-5ab5-430a-86a4-49bcb62bff35 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099269 Nov 09 04:57:18.335075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 72/143] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:18.915777 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:18.916375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:18.922080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.922518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:18.923448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.923901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:18.946224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:18.946899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:18.953348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.953842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:18.954618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:18.955100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:19.059046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:19.067249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4ba1a05c-db4e-4349-87fb-91348b81d402 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.154995 Nov 09 04:57:19.077958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 72/144] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:18 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:19.105449 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:19.113886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-93677c21-f527-46c7-ae0c-92a7e1d07a6e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.171433 Nov 09 04:57:19.114615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 73/145] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:18 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:19.208586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:19.209211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:19.214962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:19.215408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:19.216279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:19.216709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:19.221548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:19.222175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:19.227858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:19.228297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:19.229055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:19.229480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:19.348680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:19.356539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:19.357441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:19.358675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:19.359805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8de9d49e-5c61-4ba4-85c6-ce6a25842d45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.154947 Nov 09 04:57:19.360379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 73/146] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:19 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:19.365094 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a60123b7-36d0-440e-9655-43bcd5e3c234 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.148138 Nov 09 04:57:19.365646 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 74/147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:19 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:20.085030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:20.085628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:20.091276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.091758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.092513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.092940 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.131214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:20.131855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:20.137557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.137993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.138750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.139863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.224924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:20.232134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f5abca2-cd77-4299-ad7a-78fb6cd945d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.150749 Nov 09 04:57:20.233512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 74/148] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:20 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:20.274432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:20.281653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c15226ef-2562-4c0f-85c7-6294382a207f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.154032 Nov 09 04:57:20.282212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 75/149] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:20 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:20.379174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:20.379807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:20.380731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:20.381347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:20.386218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.386977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.387466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.387716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.388303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.388443 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.388728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.388836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.531428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:20.537527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:20.540097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0d3fe7b4-f60b-4223-9025-fb12a0b20aa2 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.162769 Nov 09 04:57:20.547680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 76/150] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:20 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:20.547832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:20.548602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:20.549851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-02173b06-2a07-4018-acb7-0f0a746d16a8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.175418 Nov 09 04:57:20.550999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 75/151] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:20 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:20.749495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-4c959d8a-5092-4069-8b5e-167939ddd4fa req-51d9bfd4-4da2-4c73-b7f8-ed53011ddcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e7964e-3c1d-4928-9dfa-399d3721c871", "name": "network-vif-plugged", "status": "completed", "tag": "e8784b0f-5ec8-4da9-b0e3-a4db5b8d59bf"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:20.751151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:20.751151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:20.758008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-4c959d8a-5092-4069-8b5e-167939ddd4fa req-51d9bfd4-4da2-4c73-b7f8-ed53011ddcdc service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:20.758451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-4c959d8a-5092-4069-8b5e-167939ddd4fa req-51d9bfd4-4da2-4c73-b7f8-ed53011ddcdc service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:20.769730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-4c959d8a-5092-4069-8b5e-167939ddd4fa req-51d9bfd4-4da2-4c73-b7f8-ed53011ddcdc service nova] Creating event network-vif-plugged:e8784b0f-5ec8-4da9-b0e3-a4db5b8d59bf for instance 12e7964e-3c1d-4928-9dfa-399d3721c871 on hv-cinder-81713 Nov 09 04:57:20.774546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-4c959d8a-5092-4069-8b5e-167939ddd4fa req-51d9bfd4-4da2-4c73-b7f8-ed53011ddcdc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029358 Nov 09 04:57:20.775138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 77/152] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:21.249274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:21.249971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:21.259823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.259823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.259823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.259823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.298498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:21.299181 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:21.305149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.305594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.306357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.306785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.387804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:21.395836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-967ceb00-34d3-40e5-8750-880adb49ee04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.150097 Nov 09 04:57:21.396734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 76/153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:21 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:21.442532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:21.449951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-117c70b4-ae8c-4428-b3e4-b5d69592e94a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.155399 Nov 09 04:57:21.450533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 78/154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:21 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:21.556388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:21.556993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:21.563581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.564124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.565102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.565584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.567612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:21.568241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:21.574084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.574531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.575303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:21.575824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:21.697672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:21.706829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:21.707853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76c369ff-cd86-4849-a66f-ad16885a6742 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.155057 Nov 09 04:57:21.708373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 77/155] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:21 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:21.714609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:21.716133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:21.717229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dce968e8-835a-4fb7-b3bc-a82ce4392df5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.153275 Nov 09 04:57:21.717789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 79/156] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:21 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:22.412409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:22.413029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:22.418795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.419236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.420020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.421060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.468111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:22.468716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:22.474468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.474925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.475748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.476180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.549523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:22.557007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f6d096bd-d51b-4ab2-a240-b67b903a5f93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.148181 Nov 09 04:57:22.557872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 78/157] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:22 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:22.606448 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:22.613670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-80b3d805-4700-46bc-93f0-3f113ae94ec9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.149887 Nov 09 04:57:22.614239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 80/158] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:22 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:22.724165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:22.724754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:22.730458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.730897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.731665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.732084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.733881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:22.734479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:22.740107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.740578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.741340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.741765 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.874891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:22.881888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ae757baa-d0e3-413b-9dc5-3c5dcf8ddde9 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.161338 Nov 09 04:57:22.882455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 79/159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:22 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:22.891686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-c26b9e87-8fdd-4b9a-8b0a-1adf28f447c4 req-69ce3277-1736-49d0-a83f-90dc151e3fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367541e4-c608-43b0-90da-677a42dc9b16", "name": "network-vif-plugged", "status": "completed", "tag": "4a887e80-10aa-4e62-9e15-7d3eb5cf25d5"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:22.891940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:22.892037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:22.892037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:57:22.895292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:22.895696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-c26b9e87-8fdd-4b9a-8b0a-1adf28f447c4 req-69ce3277-1736-49d0-a83f-90dc151e3fa6 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:22.896197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-c26b9e87-8fdd-4b9a-8b0a-1adf28f447c4 req-69ce3277-1736-49d0-a83f-90dc151e3fa6 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:22.896827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:22.897941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-78b3b9d8-b995-40e5-9b56-db73638e71aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.167726 Nov 09 04:57:22.902513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 81/160] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:22 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:22.906817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-c26b9e87-8fdd-4b9a-8b0a-1adf28f447c4 req-69ce3277-1736-49d0-a83f-90dc151e3fa6 service nova] Creating event network-vif-plugged:4a887e80-10aa-4e62-9e15-7d3eb5cf25d5 for instance 367541e4-c608-43b0-90da-677a42dc9b16 on hv-cinder-81713 Nov 09 04:57:22.912661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-c26b9e87-8fdd-4b9a-8b0a-1adf28f447c4 req-69ce3277-1736-49d0-a83f-90dc151e3fa6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029059 Nov 09 04:57:22.913420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 80/161] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:23.573551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:23.574655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:23.581006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.581456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.587008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.587444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.632261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:23.632965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:23.641660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.643404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.647928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.648395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.769011 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:23.776612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a7506854-a6ad-4e74-a205-7a6864443ee1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.206805 Nov 09 04:57:23.777182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 82/162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:23 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:23.844489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:23.852322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d2d19813-ea54-442c-b26f-53aa546c03f1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.225871 Nov 09 04:57:23.853036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 81/163] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:23 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:23.901831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:23.902741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:23.908766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.909271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.911078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.911078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.916122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:23.916717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:23.922624 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.923257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:23.924225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:23.924802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:24.054768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:24.069464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-456cef20-3561-4b4a-b770-f9ee9bc5e47e tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.171352 Nov 09 04:57:24.071186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 83/164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:23 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:24.101433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:24.109963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:24.111455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:24.112634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4a65243b-7bac-4ab6-99d7-08ca1fb5665b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.200286 Nov 09 04:57:24.113211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 82/165] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:23 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:24.793720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:24.794340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:24.800178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:24.800611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:24.801363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:24.801784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:24.871934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:24.872477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:24.879085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:24.879527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:24.880330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:24.880761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:24.937745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:24.945078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-addabae9-dcc2-4c9c-ad11-51381cdaa36d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.154915 Nov 09 04:57:24.945912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 84/166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:24 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:25.018036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:25.025115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-36a4927f-0508-4f6a-9e8d-45df8c3effd9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.159415 Nov 09 04:57:25.025678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 83/167] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:24 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:25.085863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:25.086469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:25.092577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:25.093025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:25.093786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:25.094353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:25.130585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:25.131244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:25.137517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:25.138024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:25.138990 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:25.139560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:25.223121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:25.230998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4f42eb12-c9e0-4cbf-91db-f63384618dd0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.148576 Nov 09 04:57:25.231589 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 85/168] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:25 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:25.277905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:25.286253 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:25.287745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:25.288813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dd4b063f-4e18-4d14-a0ec-f393543e5338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.162298 Nov 09 04:57:25.289374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 84/169] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:25 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:25.961464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:25.961999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:25.967776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:25.968228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:25.968993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:25.969441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.042786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:26.043611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:26.051001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:26.051446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.052242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:26.052666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.106875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:26.115052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cfe2fe7d-e12c-4d5b-93c6-216cd4e4f457 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.157292 Nov 09 04:57:26.115644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 86/170] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:25 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:26.183753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:26.191735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c2fb3dd1-2f58-40a5-b6f7-fcb344357667 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.153259 Nov 09 04:57:26.192301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 85/171] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:26 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:26.249086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:26.249785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:26.255921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:26.256356 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.257130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:26.257543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.306252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:26.306873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:26.312829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:26.313276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.314049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:26.314479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:26.391297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:26.398922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9fcf9763-7b92-4fee-a340-84a9d97f13a0 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1315 microversion: 2.1 time: 0.154269 Nov 09 04:57:26.408228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 87/172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:26 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:26.457740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:26.465372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:26.467412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:26.468532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2305fd31-506b-4596-a3a5-4f9664be547d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.166226 Nov 09 04:57:26.469092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 86/173] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:26 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:27.152222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:27.153418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:27.157105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-88c3750e-f4f8-4e59-92d6-20fede544d84 req-9c05abdf-21d7-4ae7-a7ae-428fe111555d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e3bd9-12b1-44b8-b263-15cd6de07fcd", "name": "network-vif-plugged", "status": "completed", "tag": "61b97e25-c60b-444c-aa5c-c81e5e096ded"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:27.163719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:27.163719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:57:27.169221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.174469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.179097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.180913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.193267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-88c3750e-f4f8-4e59-92d6-20fede544d84 req-9c05abdf-21d7-4ae7-a7ae-428fe111555d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.193729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-88c3750e-f4f8-4e59-92d6-20fede544d84 req-9c05abdf-21d7-4ae7-a7ae-428fe111555d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.218647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-88c3750e-f4f8-4e59-92d6-20fede544d84 req-9c05abdf-21d7-4ae7-a7ae-428fe111555d service nova] Creating event network-vif-plugged:61b97e25-c60b-444c-aa5c-c81e5e096ded for instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd on hv-cinder-81713 Nov 09 04:57:27.247815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-88c3750e-f4f8-4e59-92d6-20fede544d84 req-9c05abdf-21d7-4ae7-a7ae-428fe111555d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114086 Nov 09 04:57:27.253614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 87/174] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:27.292107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:27.293237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:27.313021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.313836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.315801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.319150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.430793 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:27.440485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f85443c4-a931-4c8e-b64a-667acde494e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.310762 Nov 09 04:57:27.452240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 88/175] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:27 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:27.457870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:27.459006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:27.468037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.468981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.470091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.470751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.607484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:27.623528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-61f0bb22-4322-4abb-8f8f-6ebd5315de5e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1317 microversion: 2.1 time: 0.366676 Nov 09 04:57:27.624698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 88/176] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:27 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:27.633982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:27.635239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:27.652792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.653629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.655324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:27.655870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:27.743700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:27.753283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-942b03fc-46e3-42a5-8aaf-014a2a7818d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1501 microversion: 2.1 time: 0.299145 Nov 09 04:57:27.754069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 89/177] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:27 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:27.849800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:27.861717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:27.863588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:27.865766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-56a36c0d-8583-4708-9c54-4a8376dc9022 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.237980 Nov 09 04:57:27.866897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 89/178] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:27 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:28.458750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:28.460683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:28.468158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:28.468958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:28.469806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:28.470944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:28.616749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:28.625908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-692f5b05-63d9-43a8-b62e-8bbd3b91177e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.171193 Nov 09 04:57:28.626490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 90/179] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:28 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:28.642061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:28.643400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:28.649669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:28.650511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:28.652291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:28.653121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:28.799850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:28.807568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6db3c047-a5f2-475e-bf69-76759ee33cc6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1507 microversion: 2.1 time: 0.169589 Nov 09 04:57:28.808111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 90/180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:28 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:28.888580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:28.889779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:28.895894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:28.896551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:28.897559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:28.898273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:29.049220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:29.059600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:29.062282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:29.063395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7a5f6caa-2d9a-4725-9da0-0eb7784dbf6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1407 microversion: 2.20 time: 0.178944 Nov 09 04:57:29.073257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 91/181] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:28 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:29.170418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46d13e5b-136e-4c57-8095-e8c44be45dfc"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:29.171466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:29.177509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:29.177948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:29.178752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:29.179156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:29.269012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-67d81b29-bb82-4af1-bbcc-0f51d2a2d484 req-17c392b3-597b-4fb5-bb8e-2ff68e7c5e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e4cb58-5dfa-445a-815e-30dcfaab94e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e9494d2-6026-4da9-9838-657923b0d3c9"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:29.270597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:29.270597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:29.277638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-67d81b29-bb82-4af1-bbcc-0f51d2a2d484 req-17c392b3-597b-4fb5-bb8e-2ff68e7c5e94 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:29.278092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-67d81b29-bb82-4af1-bbcc-0f51d2a2d484 req-17c392b3-597b-4fb5-bb8e-2ff68e7c5e94 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:29.290897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-67d81b29-bb82-4af1-bbcc-0f51d2a2d484 req-17c392b3-597b-4fb5-bb8e-2ff68e7c5e94 service nova] Creating event network-vif-plugged:8e9494d2-6026-4da9-9838-657923b0d3c9 for instance a2e4cb58-5dfa-445a-815e-30dcfaab94e9 on hv-cinder-81713 Nov 09 04:57:29.296389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-67d81b29-bb82-4af1-bbcc-0f51d2a2d484 req-17c392b3-597b-4fb5-bb8e-2ff68e7c5e94 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Nov 09 04:57:29.297158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 92/182] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:57:29.644539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:29.646042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:29.663553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:29.664026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:29.665399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:29.666035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:29.688763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9e927f7f-4012-48c0-8a93-c5f19c2a89d6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "POST /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522276 Nov 09 04:57:29.690450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 91/183] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:57:29 2021] POST /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:29.934565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:29.941796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a3dfe279-532d-45b4-99a4-ed9d56c145b2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.301259 Nov 09 04:57:29.942365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 93/184] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:29 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:30.083518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:30.084258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:30.090656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:30.091092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:30.091900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:30.092326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:30.217831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:30.225701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:30.227198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:30.228348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5a481223-c035-4c97-89e1-dfb6538b4e78 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1600 microversion: 2.20 time: 0.149284 Nov 09 04:57:30.228907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 92/185] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 04:57:30 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 04:57:30.246179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:30.246663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:30.253287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:30.253728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:30.254591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:30.255105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:30.369688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c111f7b5-63a7-4ce2-8216-79819b77179e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127122 Nov 09 04:57:30.370284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 94/186] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Nov 9 04:57:30 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:57:30.960144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:30.961914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:30.972031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:30.972548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:30.973754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:30.974408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:31.142889 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:31.150225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-87945dd9-50dd-4985-b565-2546103bb3d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1321 microversion: 2.1 time: 0.195780 Nov 09 04:57:31.150819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 93/187] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:30 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:31.281902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4155b26a-8569-410c-94f5-feee61196157"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:31.283927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:31.290474 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:31.290934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:31.291862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:31.292364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:31.753741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f2e5a747-fab0-4478-855c-94844da17f88 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474257 Nov 09 04:57:31.755545 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 95/188] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:57:31 2021] POST /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:31.794170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:31.795645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:31.801655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-5cd754d6-1461-425a-b87c-d7ec89b0a234 req-3abc9199-3528-4f36-b82c-8534dc29e7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034e3bd9-12b1-44b8-b263-15cd6de07fcd", "tag": "61b97e25-c60b-444c-aa5c-c81e5e096ded"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:31.804394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:31.804394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:31.811172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:31.811614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:31.812417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:31.812842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:31.816178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-5cd754d6-1461-425a-b87c-d7ec89b0a234 req-3abc9199-3528-4f36-b82c-8534dc29e7d9 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:31.816877 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-5cd754d6-1461-425a-b87c-d7ec89b0a234 req-3abc9199-3528-4f36-b82c-8534dc29e7d9 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:31.830795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-5cd754d6-1461-425a-b87c-d7ec89b0a234 req-3abc9199-3528-4f36-b82c-8534dc29e7d9 service nova] Creating event network-changed:61b97e25-c60b-444c-aa5c-c81e5e096ded for instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd on hv-cinder-81713 Nov 09 04:57:31.836847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-5cd754d6-1461-425a-b87c-d7ec89b0a234 req-3abc9199-3528-4f36-b82c-8534dc29e7d9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040904 Nov 09 04:57:31.838060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 96/189] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:57:31.981623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-49244e4a-e995-4279-8e35-a93fa9322731 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.192657 Nov 09 04:57:31.983054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 94/190] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:31 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:32.171399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:32.172475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:32.184143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:32.184940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:32.185951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:32.186573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:32.351612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:32.358891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ce4bc102-be63-46d6-b9b3-08b8a437d7bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1516 microversion: 2.1 time: 0.193825 Nov 09 04:57:32.359468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 97/191] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:32 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:32.378049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:32.379158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:32.386129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:32.386578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:32.387400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:32.388028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:32.412973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lazy-loading 'flavor' on Instance uuid a2e4cb58-5dfa-445a-815e-30dcfaab94e9 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:57:32.527787 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aa364dee-fd69-4028-ba66-8d5f1879728f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9/action" status: 200 len: 32 microversion: 2.1 time: 0.154703 Nov 09 04:57:32.528726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 95/192] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:57:32 2021] POST /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:57:32.537720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:32.538329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:32.545021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:32.545477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:32.546258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:32.546850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:32.708651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:32.717421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ae9e7bf9-7506-4dcd-81ad-bc151116df79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.183129 Nov 09 04:57:32.728080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 98/193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:32 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:32.993291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:32.994281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:33.000849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:33.001517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:33.002288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:33.002887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:33.734143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:33.734851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:33.741092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:33.741606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:33.742379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:33.742810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:33.877247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:33.884867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8ea3b1a-e411-4d38-b908-74d7c11cd356 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.154486 Nov 09 04:57:33.885431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 99/194] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:33 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:34.901984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:34.902618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:34.911002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:34.911641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:34.912901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:34.913510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:35.049028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:35.057579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3d47c26b-6f76-4096-b0d1-7f576ffa562a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.159192 Nov 09 04:57:35.058188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 100/195] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:34 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:36.074536 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:36.075262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:36.095259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:36.095751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:36.096554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:36.097024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:36.132283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e2f8beeb-d681-441a-ab0e-4e35c361afcb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 3.143264 Nov 09 04:57:36.135529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 96/196] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:32 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:36.526143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:36.539283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3a73fb46-2fcf-4100-9482-117a8a5ee9da tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.468517 Nov 09 04:57:36.540602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 101/197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:36 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:37.147410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:37.149502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:37.158659 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:37.159831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:37.160788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:37.161764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:37.281185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-59439dce-8d66-479e-b9b9-a2dd1991aa35 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.141132 Nov 09 04:57:37.281868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 97/198] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:37 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:37.561290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:37.561988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:37.569075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:37.569905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:37.571141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:37.572278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:37.773122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:37.782833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-824c59a2-bc8e-4aa4-a829-0e5d3a217332 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.225235 Nov 09 04:57:37.783655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 102/199] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:37 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:38.088230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1589755376", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "2b01fa8a-95e4-433e-8d69-a2e7b25559a4"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:38.148201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] validate_networks() for [('2b01fa8a-95e4-433e-8d69-a2e7b25559a4', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:57:38.292297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:38.293575 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:38.301255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:38.301970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:38.303787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:38.304901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:38.436315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c4671836-2a3a-4618-b57a-388addd3324b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.146440 Nov 09 04:57:38.437015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 103/200] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:38 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:38.529578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:57:38.530045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:57:38.530507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:57:38.530911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:57:38.531312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:57:38.540043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:38.540469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:38.541302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:38.541768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:38.558985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Getting quotas for project 0bab423d141e49b29b86b769cfa8d939. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:57:38.563806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Getting quotas for user 0952832b106844dea05a888f4266dd95 and project 0bab423d141e49b29b86b769cfa8d939. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:57:38.574730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:57:38.577774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:57:38.620707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6fc390ee-07c2-44e0-bbab-2e21cb2dfa30 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536822 Nov 09 04:57:38.621262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 98/201] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:57:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:57:38.632182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dea685f0-a02d-42b6-915a-21d1cdff33b2 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:38.632865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dea685f0-a02d-42b6-915a-21d1cdff33b2 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:38.698433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dea685f0-a02d-42b6-915a-21d1cdff33b2 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:38.705196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dea685f0-a02d-42b6-915a-21d1cdff33b2 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1214 microversion: 2.1 time: 0.077017 Nov 09 04:57:38.706267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 104/202] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:38 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:38.801996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:38.802495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:38.811084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:38.811547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:38.812570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:38.813011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:38.985093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:38.999926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f582b089-c1cc-4d17-8701-8275fc75bde3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.203050 Nov 09 04:57:39.000627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 99/203] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:38 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:39.447964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:39.449054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:39.456652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:39.457426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:39.458385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:39.458905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:39.594169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-382af627-d651-4bb2-a92e-49c82600de9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.151048 Nov 09 04:57:39.594825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 105/204] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:39 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:39.722283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:39.722880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:39.729059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:39.729529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:39.730279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:39.730702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:39.787731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:39.794761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e8a7c9e6-aac0-485f-ae29-0d8e28a5ef09 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1266 microversion: 2.1 time: 0.076010 Nov 09 04:57:39.795324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 100/205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:39 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:40.017930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:40.018525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:40.025387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:40.025839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:40.027484 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:40.028013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:40.522580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:40.531717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-41ba6362-bf2c-48f0-b509-a1d4b72404b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.518515 Nov 09 04:57:40.533552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 106/206] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:40 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:40.612459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:40.617308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:40.628261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:40.628704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:40.629482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:40.629961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:40.784674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5b7fff50-c1e3-4830-b542-8bf7f851c2a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.181908 Nov 09 04:57:40.785594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 101/207] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:40 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:40.816248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:40.816870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:40.826022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:40.826477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:40.829875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:40.830562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:40.905505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:40.913049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6d2c0b8c-8b99-4eda-b9b0-285d0f13c58d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1272 microversion: 2.1 time: 0.104802 Nov 09 04:57:40.913837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 107/208] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:40 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:41.550867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:41.551553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:41.561507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:41.576685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:41.577666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:41.578114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:41.774699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:41.788871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6ccf51e7-2299-45c5-91ab-1ed5dfedbbfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.242417 Nov 09 04:57:41.789601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 102/209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:41 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:41.796913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:41.797840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:41.803789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:41.804237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:41.805180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:41.805621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:41.930034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:41.930719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:41.937790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:41.938481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:41.939368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:41.939991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:41.953037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c0ea2b0d-ae2b-4c12-b361-d612329d3234 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.160239 Nov 09 04:57:41.953824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 108/210] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:41 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:42.291106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-5e4fa9b1-d604-4eb7-963e-da9f5e99ede1 req-874ff52b-43c6-496f-b197-8e5b55bcdb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926a492f-db29-4e1e-bec9-8bb044ed9222", "tag": "e23817bc-a285-4bc5-a517-b404e94ba176"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:42.293504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:42.293504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:42.302861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:42.320646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-821dbee8-a84f-4635-a3e0-84b0938c3701 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.394060 Nov 09 04:57:42.321633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 103/211] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:41 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:42.326461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-5e4fa9b1-d604-4eb7-963e-da9f5e99ede1 req-874ff52b-43c6-496f-b197-8e5b55bcdb2e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:42.326904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-5e4fa9b1-d604-4eb7-963e-da9f5e99ede1 req-874ff52b-43c6-496f-b197-8e5b55bcdb2e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:42.339147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-5e4fa9b1-d604-4eb7-963e-da9f5e99ede1 req-874ff52b-43c6-496f-b197-8e5b55bcdb2e service nova] Creating event network-changed:e23817bc-a285-4bc5-a517-b404e94ba176 for instance 926a492f-db29-4e1e-bec9-8bb044ed9222 on hv-cinder-81713 Nov 09 04:57:42.344130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-5e4fa9b1-d604-4eb7-963e-da9f5e99ede1 req-874ff52b-43c6-496f-b197-8e5b55bcdb2e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058087 Nov 09 04:57:42.344710 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 109/212] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:42.806983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:42.807742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:42.817719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:42.818169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:42.818977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:42.824531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:42.971216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:42.974863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:42.991899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:42.992718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:42.993583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:42.994981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:43.028392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:43.037151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-71b08b53-2b17-4027-a83a-9269543c8620 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.233915 Nov 09 04:57:43.047928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 104/213] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:42 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:43.194253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-06d20706-cca2-40c1-be5d-89f31a7bb736 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.232855 Nov 09 04:57:43.195326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 110/214] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:42 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:43.342561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:43.343533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:43.349698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:43.350794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:43.351842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:43.352524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:43.535406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:43.550386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9872a6e5-1e7b-4f41-9ba7-55a8d5cdc3fe tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.215078 Nov 09 04:57:43.554161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 105/215] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:43 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:44.062269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:44.063092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:44.070622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:44.071024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:44.071855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:44.072296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:44.205542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:44.207132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:44.214863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:44.215658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:44.216581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:44.217083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:44.241199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:44.250356 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9a91b855-5e92-4bf0-83ae-64f5a418873e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.197075 Nov 09 04:57:44.250996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 111/216] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:44 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:44.483405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-894b017b-a063-4622-b5f4-b6e236a91812 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.281427 Nov 09 04:57:44.487544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 106/217] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:44 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:44.575847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:44.577209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:44.584167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:44.585620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:44.586768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:44.587343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:44.784917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:44.800307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5c9ef005-5065-4e8d-aead-68eb6403417e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.230009 Nov 09 04:57:44.803665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 112/218] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:44 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:45.268985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:45.270265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:45.283495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:45.284058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:45.285005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:45.285537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:45.498725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:45.502291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:45.512113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:45.513222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:45.515594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:45.518383 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:45.521831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-471f3bc2-51c0-4b2a-a252-5d20fd8b83aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.258469 Nov 09 04:57:45.522498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:45.523170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 107/219] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:45 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:45.658285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c2753d03-2084-4ef4-9553-89cf574f1319 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.164266 Nov 09 04:57:45.659266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 113/220] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:45 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:45.817211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:45.818064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:45.824201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:45.824741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:45.825650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:45.826074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.012004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:46.020022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-69802d73-0e83-417a-8b12-58e7039e7e8e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.205479 Nov 09 04:57:46.020022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 108/221] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:45 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:46.085695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:46.086287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:46.093638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.094139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.094874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.095307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.120239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 04:57:46.207220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85902a08-4a58-47ca-a0d3-8c77d1391978 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 204 len: 0 microversion: 2.1 time: 0.125103 Nov 09 04:57:46.208076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 114/222] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 04:57:46 2021] DELETE /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 04:57:46.215653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:46.216891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:46.226501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.227045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.227976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.228461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.364712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:46.372551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a2571e56-b388-4670-9573-b85001cad085 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1553 microversion: 2.1 time: 0.160616 Nov 09 04:57:46.373126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 109/223] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:46 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:46.540151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:46.540771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:46.550092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.550538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.551437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.551888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.668702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:46.669979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:46.676772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.677444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.678444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:46.678905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:46.695248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:46.701934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4499eac8-1178-4cc9-8b9b-cfe1a778ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.165970 Nov 09 04:57:46.702747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 115/224] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:46 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:46.808283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-df3890e4-d2a7-470f-b06a-465280e7cf43 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.142972 Nov 09 04:57:46.808920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 110/225] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:46 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:47.036937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:47.037779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:47.047186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.048305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.049440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.049839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.223571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:47.231461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-baba27d6-ad82-40e5-af6e-449d051e8770 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.197965 Nov 09 04:57:47.232399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 116/226] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:47 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:47.391705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:47.392965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:47.400635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.401164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.402447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.402854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.537472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:47.546291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a7e619a5-e3bb-4618-a6ce-2ec2780a28cd tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1553 microversion: 2.1 time: 0.158917 Nov 09 04:57:47.546853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 111/227] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:47 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:47.719089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:47.719706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:47.726526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.726966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.727762 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.728189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.821864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:47.822703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:47.830736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.831183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.831998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:47.832424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:47.861959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:47.869204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2f61aab9-cdff-4494-b062-0a90f2e8f83e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.153850 Nov 09 04:57:47.869856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 117/228] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:47 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:47.971239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f99ab4a6-f71a-4d83-ac12-ca5913a978f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 14 microversion: 2.20 time: 0.153912 Nov 09 04:57:47.971808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 112/229] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:47 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:48.249668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:48.250506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:48.258444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.258897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.259761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.260218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.392378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:48.399739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-17f14a23-291d-4aef-9c0a-011cc7d82386 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.154253 Nov 09 04:57:48.400446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 118/230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:48 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:48.562849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:48.563543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:48.570684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.571129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.571928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.572351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.705510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:48.713649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ffded225-a7cf-4bf0-8d30-ad23c89a9f07 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1553 microversion: 2.1 time: 0.154962 Nov 09 04:57:48.714204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 113/231] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:48 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:48.886086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:48.886695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:48.892520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.892962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.893734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.894162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.982568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:48.983480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:48.989700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.990140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:48.990909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:48.991339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:49.030160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:49.038655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-68ebe124-a894-4380-b8c6-38821bb06a5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.156257 Nov 09 04:57:49.047886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 119/232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:48 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:49.176081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b09b87e6-b662-448f-b9b2-0ebad8db1128 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 6950 microversion: 2.20 time: 0.197446 Nov 09 04:57:49.176643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 114/233] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:48 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 6950 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 04:57:49.418015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:49.418623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:49.424493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:49.424936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:49.425703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:49.426180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:49.573698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:49.583656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d7d93122-779f-4c61-84e6-91b5ebcbfd4e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.169175 Nov 09 04:57:49.593648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 120/234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:49 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:49.731239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:49.732291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:49.739274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:49.739926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:49.740719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:49.741146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:49.884685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:49.893347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-65ed2768-e701-451d-83a7-cb71ff7a6623 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1553 microversion: 2.1 time: 0.166337 Nov 09 04:57:49.893921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 115/235] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:49 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:50.062362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:50.063943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:50.086816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.087722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.088805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.089442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.163443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-efd31472-4f0f-47f7-be38-e5704395b0c7 req-1b353e73-a8eb-4244-aada-e41d7c2c0970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a87e643-d686-4a9b-b027-d72b89ab2e12", "name": "network-vif-deleted", "tag": "d6b95a2c-0b66-4503-93bb-c3d25b0b0db8"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:50.165381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:50.165381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:57:50.173425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-efd31472-4f0f-47f7-be38-e5704395b0c7 req-1b353e73-a8eb-4244-aada-e41d7c2c0970 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.173865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-efd31472-4f0f-47f7-be38-e5704395b0c7 req-1b353e73-a8eb-4244-aada-e41d7c2c0970 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.185680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-efd31472-4f0f-47f7-be38-e5704395b0c7 req-1b353e73-a8eb-4244-aada-e41d7c2c0970 service nova] Creating event network-vif-deleted:d6b95a2c-0b66-4503-93bb-c3d25b0b0db8 for instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 on hv-cinder-81713 Nov 09 04:57:50.190951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-efd31472-4f0f-47f7-be38-e5704395b0c7 req-1b353e73-a8eb-4244-aada-e41d7c2c0970 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036874 Nov 09 04:57:50.191676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 116/236] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:50.197801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:50.198832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:50.206670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.207559 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.209743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.210460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.290193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:50.298781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-11a0c581-7555-4671-8309-20e6a52814f5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.247752 Nov 09 04:57:50.305482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 121/237] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:50 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:50.365751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ed3ff99b-56b8-487a-9ea0-bdf8417b0971 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 12027 microversion: 2.20 time: 0.172301 Nov 09 04:57:50.369510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 117/238] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:50 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 12027 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:57:50.600460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:50.601063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:50.607418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.607893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.608660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.609087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.739606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:50.747170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ebe4137c-f7ef-4bc4-b380-da01936ee6ff tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.150491 Nov 09 04:57:50.747973 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 122/239] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:50 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:50.911671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:50.912529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:50.920629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.921077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.922001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.922634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.959171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:50.959710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:50.960102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lazy-loading 'fault' on Instance uuid 5a87e643-d686-4a9b-b027-d72b89ab2e12 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:57:51.005579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592dc580513e4330b1e64575920f0a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27238c465f3941fb932e099dca430763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:51.015071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-852f59dc-2c3d-43e4-8ea3-795e1c540d4c tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 200 len: 1351 microversion: 2.1 time: 0.107904 Nov 09 04:57:51.016018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 118/240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:50 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:51.146229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-d41ede70-2b4a-41f5-8533-5ca5885497ff req-664362aa-ac1c-4c27-b0ea-6208b6e22c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926a492f-db29-4e1e-bec9-8bb044ed9222", "name": "network-vif-plugged", "status": "completed", "tag": "e23817bc-a285-4bc5-a517-b404e94ba176"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:51.149929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:57:51.149929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:57:51.164062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d41ede70-2b4a-41f5-8533-5ca5885497ff req-664362aa-ac1c-4c27-b0ea-6208b6e22c90 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.172872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d41ede70-2b4a-41f5-8533-5ca5885497ff req-664362aa-ac1c-4c27-b0ea-6208b6e22c90 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.186214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-d41ede70-2b4a-41f5-8533-5ca5885497ff req-664362aa-ac1c-4c27-b0ea-6208b6e22c90 service nova] Creating event network-vif-plugged:e23817bc-a285-4bc5-a517-b404e94ba176 for instance 926a492f-db29-4e1e-bec9-8bb044ed9222 on hv-cinder-81713 Nov 09 04:57:51.191225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-d41ede70-2b4a-41f5-8533-5ca5885497ff req-664362aa-ac1c-4c27-b0ea-6208b6e22c90 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051295 Nov 09 04:57:51.192774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 123/241] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:57:51.316513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:51.317112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:51.326410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.326870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.327700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.328147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.378837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:51.379888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:51.401692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.408414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.409324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.409770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.518603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:51.525866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fb5fa20c-9fff-4fb9-a52e-75c6a4308e69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.212972 Nov 09 04:57:51.526431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 119/242] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:51 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:51.587409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-08be58b6-8ece-4b06-94e2-5ddb1bdd0950 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 15480 microversion: 2.20 time: 0.213526 Nov 09 04:57:51.588302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 124/243] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:51 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 15480 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:57:51.763952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:51.764659 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:51.770932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.771300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.772123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:51.772967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:51.935038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:51.942578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d06c075b-63d7-41bc-ab7b-07b8dd5b9e4c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.182110 Nov 09 04:57:51.943279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 120/244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:51 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:52.033928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:52.034700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:52.041589 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.042052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.042802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.043232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.059093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] HTTP exception thrown: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. Nov 09 04:57:52.060577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Returning 404 to user: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:57:52.061571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9d5e81d0-cf2f-43a6-9c1a-747ea36ae853 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 404 len: 111 microversion: 2.1 time: 0.032047 Nov 09 04:57:52.065841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 125/245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:52 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 04:57:52.171288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:52.173216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:52.179393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.180417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.181754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.182441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.196921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] HTTP exception thrown: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. Nov 09 04:57:52.197813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Returning 404 to user: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:57:52.199050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a832f2ef-afab-4f9a-92ed-742452a033d7 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032148 Nov 09 04:57:52.200835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 121/246] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:57:52 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 04:57:52.542165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:52.543022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:52.550312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.551047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.552008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.552436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.599438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:52.600537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:52.610217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.612173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.613181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.614311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.749558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:52.757488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-40b74e04-30fb-49f0-af18-ba4b1e84d418 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.218825 Nov 09 04:57:52.758343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 126/247] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:52 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:52.860886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-496f5b16-d33f-467c-b799-4067216d6acd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 17602 microversion: 2.20 time: 0.264935 Nov 09 04:57:52.861910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 122/248] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:52 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 17602 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:57:52.970792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:52.971506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:52.987957 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.988403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:52.989557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:52.990083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.142708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:53.151319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d18e07c1-b804-47ae-9f8b-53da8acfb246 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1314 microversion: 2.1 time: 0.194436 Nov 09 04:57:53.151912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 127/249] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:52 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:53.415471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:53.416654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:53.428745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.429323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.430174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.430677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.445307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] HTTP exception thrown: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. Nov 09 04:57:53.446029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Returning 404 to user: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:57:53.447013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-728e9444-12e1-4cd7-a11c-960f1b32bce6 tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 404 len: 111 microversion: 2.1 time: 0.035958 Nov 09 04:57:53.447753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 123/250] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 04:57:53 2021] DELETE /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 04:57:53.460055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:53.460967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] [instance: 5a87e643-d686-4a9b-b027-d72b89ab2e12] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:53.469603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.470261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.471412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.472046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.493768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] HTTP exception thrown: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. Nov 09 04:57:53.494734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] Returning 404 to user: Instance 5a87e643-d686-4a9b-b027-d72b89ab2e12 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:57:53.495894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d08232d7-9bb0-482c-bcd2-e57eecd7c2bc tempest-DeleteServersTestJSON-1474856640 tempest-DeleteServersTestJSON-1474856640-project] 10.222.0.41 "GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12" status: 404 len: 111 microversion: 2.1 time: 0.042974 Nov 09 04:57:53.497563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 128/251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:53 2021] GET /compute/v2.1/servers/5a87e643-d686-4a9b-b027-d72b89ab2e12 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 04:57:53.775777 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:53.777411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:53.785047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.785403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.786208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.786623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.872340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:53.874001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:53.883110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.883904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:53.885241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:53.896893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:54.049122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e543cb98-bf28-4127-a661-4311e7ea81f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 17602 microversion: 2.20 time: 0.180386 Nov 09 04:57:54.050482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 129/252] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:53 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 17602 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:57:54.142635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:54.154535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e2d2f0d2-20cb-4776-b992-37a4cfbbe977 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.383537 Nov 09 04:57:54.155582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 124/253] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:53 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:54.171093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:54.173095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:54.184137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:54.185575 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:54.186320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:54.186752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:54.695968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:54.705407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1482428460", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "9dc74574-bcbe-4d7d-85c6-61611faf1df6"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:54.708131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e6b3bf2d-2c54-43b2-9ac5-d4ce5a214a10 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1498 microversion: 2.1 time: 0.541748 Nov 09 04:57:54.708131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 130/254] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:54 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1498 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:54.802210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] validate_networks() for [('9dc74574-bcbe-4d7d-85c6-61611faf1df6', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:57:55.064066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:55.065466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:55.076185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:55.077481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:55.079141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:55.079863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:55.217764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a23b4d8e-8985-463f-862f-e6028c4359ae tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 19289 microversion: 2.20 time: 0.160276 Nov 09 04:57:55.219254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 131/255] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:55 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 19289 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:57:55.226235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:55.227279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:55.236885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:55.238459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:55.240174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:55.240875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:55.284517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:57:55.284946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:57:55.285422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:57:55.285828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:57:55.286233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:57:55.304548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:55.305243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:55.306279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:55.306912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:55.332229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:57:55.337352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for user 2dc41f90272e4a549aad1634f08342a6 and project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:57:55.362048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:57:55.365554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:57:55.455776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b1483dbd-9edd-4bb1-830c-9c14aac82afa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756150 Nov 09 04:57:55.456436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 125/256] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:57:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:57:55.461462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:55.469763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c13081c2-35c3-4d57-8256-c88bb51ded99 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:55.471087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-689186a6-864a-4641-a1f1-7fc1c1ec69e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.250212 Nov 09 04:57:55.482297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 132/257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:55 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:55.488506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c13081c2-35c3-4d57-8256-c88bb51ded99 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:55.582987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c13081c2-35c3-4d57-8256-c88bb51ded99 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:55.594013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c13081c2-35c3-4d57-8256-c88bb51ded99 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1218 microversion: 2.1 time: 0.128083 Nov 09 04:57:55.595409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 126/258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:55 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:56.000522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:56.001067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:56.013183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.013936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.015255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.015886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.049197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 04:57:56.164455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c8aad629-1279-4459-84a4-c92494dbbdd9 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "DELETE /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 204 len: 0 microversion: 2.1 time: 0.168158 Nov 09 04:57:56.165455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 133/259] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 04:57:55 2021] DELETE /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 04:57:56.173082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:56.174527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:56.180838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.181604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.182581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.183199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.231198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:56.232521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:56.252793 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.259525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.260794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.261443 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.410588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:56.422575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-59ef98de-96b1-4517-9e3d-c29089da1b9b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1504 microversion: 2.1 time: 0.253080 Nov 09 04:57:56.426287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 127/260] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:56 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:56.446237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-30ae1e00-7fed-4b38-88db-7ba49ec64bf6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 21040 microversion: 2.20 time: 0.219617 Nov 09 04:57:56.446991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 134/261] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:56 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 21040 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:57:56.492692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:56.492692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:56.502918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.504129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.505136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.505850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.613870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:56.615173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:56.627045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.628074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.629611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:56.630351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:56.916578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:56.919718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:56.925008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-af856199-a3f1-4f11-8578-c8db7f97d166 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1270 microversion: 2.1 time: 0.317135 Nov 09 04:57:56.927024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 135/262] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:56 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:56.938759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fe44a665-1a40-4de0-b83c-c8c604c02e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.453163 Nov 09 04:57:56.948934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 128/263] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:56 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:57.443903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:57.444895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:57.453985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.453985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.454560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.455783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.461760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:57.463346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:57.471431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.472232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.473281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.473949 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.636997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d73fceb9-145c-4135-961e-d48485c0de1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 22323 microversion: 2.20 time: 0.181288 Nov 09 04:57:57.641232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 129/264] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:57 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 22323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:57:57.786930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:57.795472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0686866c-d1b5-4066-980e-a652ce7e9e50 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1504 microversion: 2.1 time: 0.357100 Nov 09 04:57:57.806558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 136/265] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:57 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:57.947584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:57.948318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:57.962117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.962858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.963392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.964252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:57.965437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:57.971846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.983158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.983943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:57.986525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:57.987094 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:58.051668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:58.063092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c03db9c5-ae18-492b-ada1-fd073c676ac6 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1276 microversion: 2.1 time: 0.120645 Nov 09 04:57:58.072950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 130/266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:57 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:58.455027 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:58.468223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1303d8c2-5ea1-4c46-82bc-fe9092b8d2c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.515314 Nov 09 04:57:58.478573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 137/267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:57 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:57:58.649462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:57:58.650326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:58.657167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:58.657621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:58.664939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:58.665419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:58.827441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:58.828561 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:58.852198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:58.858638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:58.859681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:58.860132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:59.034086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ac0c5d6d-0baa-4e27-a8fc-6b6e2fb2ef52 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 23224 microversion: 2.20 time: 0.386717 Nov 09 04:57:59.035162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 131/268] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:57:58 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 23224 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:57:59.086517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:59.087349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:59.095552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:59.096397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:59.097405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:59.098051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:59.298186 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:59.310602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-670abe72-a412-4374-b958-9c5f2ff43f62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.233129 Nov 09 04:57:59.311675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 132/269] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:59 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:59.447094 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:59.456346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-110855f1-6f84-4bbc-93d4-b6fbc9d2229c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1504 microversion: 2.1 time: 0.642769 Nov 09 04:57:59.456346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 138/270] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:58 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1504 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:57:59.486148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:57:59.486779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:57:59.492717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:59.493161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:59.493937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:57:59.494549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:57:59.637020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:57:59.646142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4e4f76d1-295f-4d9f-991d-7e11def5537c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.163703 Nov 09 04:57:59.646745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 133/271] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:57:59 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:00.046836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:00.048325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:00.081241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.081690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.082505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.082950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.250354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-22bf1b2a-9881-4d5d-a249-9622ff9fb407 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 24392 microversion: 2.20 time: 0.207892 Nov 09 04:58:00.254692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 139/272] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:00 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 24392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:00.329135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:00.330326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:00.339782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.340391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.341594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.342169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.473302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:00.474110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:00.487016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.489184 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.492191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.492876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.599013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:00.618823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1a5477c0-a693-4954-ac67-838ffd0f9548 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.295171 Nov 09 04:58:00.619877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 134/273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:00 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:00.667044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:00.680200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:00.695211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.696665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:00.699291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:00.700986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:01.107258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:01.116690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d142256a-1f4f-4fff-a594-5989b199973b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.456555 Nov 09 04:58:01.117264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 135/274] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:00 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:01.123051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-d95cacf4-d281-4c0c-8824-5a1334534763 req-155ab33d-16db-40be-acb4-8b803ce20ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4587bfc-3272-4893-a25b-9e3cdbcd8f47", "tag": "ac852503-70fb-48a9-b3d8-4f2cac27b230"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:01.124678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:01.124678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:58:01.131888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-d95cacf4-d281-4c0c-8824-5a1334534763 req-155ab33d-16db-40be-acb4-8b803ce20ed1 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:01.132327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-d95cacf4-d281-4c0c-8824-5a1334534763 req-155ab33d-16db-40be-acb4-8b803ce20ed1 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:01.143914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-d95cacf4-d281-4c0c-8824-5a1334534763 req-155ab33d-16db-40be-acb4-8b803ce20ed1 service nova] Creating event network-changed:ac852503-70fb-48a9-b3d8-4f2cac27b230 for instance f4587bfc-3272-4893-a25b-9e3cdbcd8f47 on hv-cinder-81713 Nov 09 04:58:01.149063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-d95cacf4-d281-4c0c-8824-5a1334534763 req-155ab33d-16db-40be-acb4-8b803ce20ed1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030158 Nov 09 04:58:01.149665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 136/275] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:01.171747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:01.179175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-696be010-a3a0-4d2c-b79c-6ee6f339cec6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 200 len: 1504 microversion: 2.1 time: 0.710314 Nov 09 04:58:01.179875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 140/276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:00 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 1504 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:01.265146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:01.266306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:01.273961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:01.274549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:01.275410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:01.275956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:01.456842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a8739309-89fa-40e5-bd21-c8aa4b368a18 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 25469 microversion: 2.20 time: 0.197680 Nov 09 04:58:01.457981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 137/277] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:01 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 25469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:01.637326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:01.638718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:01.644964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:01.645422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:01.646379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:01.646980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:01.931776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:01.946273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-21f1fcd2-42f6-4ae5-bd2f-a3e7e67d829b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.311975 Nov 09 04:58:01.946847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 141/278] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:01 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:02.137187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:02.138416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:02.150586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.151039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.157851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.158368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.197999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:02.199683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: 926a492f-db29-4e1e-bec9-8bb044ed9222] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:02.210993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.211995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.212827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.213251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.234378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] HTTP exception thrown: Instance 926a492f-db29-4e1e-bec9-8bb044ed9222 could not be found. Nov 09 04:58:02.235440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Returning 404 to user: Instance 926a492f-db29-4e1e-bec9-8bb044ed9222 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:58:02.236299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2857ac86-6e6f-469e-b6a8-d6cba251294b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222" status: 404 len: 111 microversion: 2.1 time: 0.043289 Nov 09 04:58:02.239711 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 142/279] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:02 2021] GET /compute/v2.1/servers/926a492f-db29-4e1e-bec9-8bb044ed9222 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 04:58:02.376459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-65806666", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "2b01fa8a-95e4-433e-8d69-a2e7b25559a4"}]}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:02.442193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] validate_networks() for [('2b01fa8a-95e4-433e-8d69-a2e7b25559a4', None, None, None, None, None)] {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:58:02.520054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:02.528569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-84010fda-8c01-4317-8661-262bba1f84b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.395491 Nov 09 04:58:02.529422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 138/280] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:02 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:02.543831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:02.544937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:02.551324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.552021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.552963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.553557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.680999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f31fd747-0472-4053-bd26-7fbaee34bf36 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 26712 microversion: 2.20 time: 0.140692 Nov 09 04:58:02.684815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 139/281] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:02 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 26712 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:02.964704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:02.966610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:02.979890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.980351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:02.981200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:02.981643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.254838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:03.270586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8f145d39-dc13-4ca9-b5d5-422092e84ea3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.308228 Nov 09 04:58:03.271442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 140/282] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:02 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:03.279440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-bdd6394b-b6c7-454f-8090-a3269dcb4dcc req-ac4ff6d7-67a0-440e-bd18-ae6ed4ededc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926a492f-db29-4e1e-bec9-8bb044ed9222", "name": "network-vif-deleted", "tag": "e23817bc-a285-4bc5-a517-b404e94ba176"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:03.281222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:03.281222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:58:03.299448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-bdd6394b-b6c7-454f-8090-a3269dcb4dcc req-ac4ff6d7-67a0-440e-bd18-ae6ed4ededc9 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.299944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-bdd6394b-b6c7-454f-8090-a3269dcb4dcc req-ac4ff6d7-67a0-440e-bd18-ae6ed4ededc9 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.327260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-bdd6394b-b6c7-454f-8090-a3269dcb4dcc req-ac4ff6d7-67a0-440e-bd18-ae6ed4ededc9 service nova] Creating event network-vif-deleted:e23817bc-a285-4bc5-a517-b404e94ba176 for instance 926a492f-db29-4e1e-bec9-8bb044ed9222 on hv-cinder-81713 Nov 09 04:58:03.346015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-bdd6394b-b6c7-454f-8090-a3269dcb4dcc req-ac4ff6d7-67a0-440e-bd18-ae6ed4ededc9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063911 Nov 09 04:58:03.351753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 141/283] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:03.376917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:58:03.378585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:58:03.380037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:58:03.381251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:58:03.383400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:58:03.409703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.410173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.412487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.413148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.480389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Getting quotas for project 0bab423d141e49b29b86b769cfa8d939. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:03.492102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Getting quotas for user 0952832b106844dea05a888f4266dd95 and project 0bab423d141e49b29b86b769cfa8d939. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:03.516637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:58:03.520063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:58:03.546928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:03.547652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:03.578232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.581012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.587825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.588319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.617113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-023dcd64-750f-4c6a-a085-53d0409d95b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244722 Nov 09 04:58:03.619158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 143/284] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:58:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:58:03.631434 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a7de3c94-5359-47fe-afd3-21020670b511 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:03.633709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a7de3c94-5359-47fe-afd3-21020670b511 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:03.728102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a7de3c94-5359-47fe-afd3-21020670b511 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:03.737049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a7de3c94-5359-47fe-afd3-21020670b511 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1212 microversion: 2.1 time: 0.111924 Nov 09 04:58:03.738554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 144/285] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:03 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1212 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:03.744538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:03.745947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:03.771103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.773492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.775259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:03.776122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:03.930165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c70cd77c-eca9-42bd-b210-fa61c86cca90 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 27408 microversion: 2.20 time: 0.190082 Nov 09 04:58:03.931444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 145/286] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:03 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 27408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:04.016365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:04.025526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-427ffd5f-7121-42b0-816e-94edbd2ff65f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.484035 Nov 09 04:58:04.043874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 142/287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:03 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:04.295574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:04.298794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:04.312763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:04.313207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:04.315006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:04.315842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:04.482227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:04.491490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e77d3adf-761c-4c19-8bcf-83aa9730995f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.206652 Nov 09 04:58:04.492427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 146/288] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:04 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:04.753608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:04.754214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:04.766778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:04.775938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:04.777145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:04.777780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:04.883740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:04.896138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eb83edb6-0f86-4ebf-8bd1-54ed4d3f9d0e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1264 microversion: 2.1 time: 0.146039 Nov 09 04:58:04.908331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 143/289] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:04 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:04.944916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:04.946322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:04.955470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:04.956233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:04.958276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:04.958917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:05.051539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:05.054488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:05.073103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:05.075746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:05.076715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:05.077309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:05.183284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-57b7ba7c-eeff-4aea-93c7-06e3a759c075 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 27664 microversion: 2.20 time: 0.244090 Nov 09 04:58:05.184640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 147/290] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:04 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 27664 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:05.331693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:05.341417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bc3c0e66-43c7-4a60-bfab-c61720009c8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.297612 Nov 09 04:58:05.342910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 144/291] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:05 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:05.374843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a077a66e-3444-4376-a157-5e890b270e89 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'create', calling method: .version_select at 0x7f30cc18cee0>, body: {"keypair": {"name": "tempest-keypair-457445519"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:05.401691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a077a66e-3444-4376-a157-5e890b270e89 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:05.415258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a077a66e-3444-4376-a157-5e890b270e89 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for user 07d92b2e7b1b46f6916c335b25a44ecf and project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:05.509443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:05.510335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:05.518061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:05.523198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:05.524374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:05.525157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:05.726511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:05.735350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b050e4ab-72dd-4fe4-98c8-cade2ac3f8c2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.229035 Nov 09 04:58:05.736492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 145/292] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:05 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:05.819457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a077a66e-3444-4376-a157-5e890b270e89 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:05.823290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a077a66e-3444-4376-a157-5e890b270e89 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for user 07d92b2e7b1b46f6916c335b25a44ecf and project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:05.854258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a077a66e-3444-4376-a157-5e890b270e89 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.668228 Nov 09 04:58:05.854883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 148/293] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 9 04:58:05 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:05.914655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:05.915345 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:05.927934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:05.929561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:05.930640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:05.931075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.025169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:06.035536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-970870bb-50f2-4e4d-8305-c5be3388ae8d tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1270 microversion: 2.1 time: 0.124787 Nov 09 04:58:06.045187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 146/294] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:05 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:06.196229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:06.197288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:06.213508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:06.214439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.217090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:06.217506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.359899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:06.361589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:06.372155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:06.372712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.373668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:06.374193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.432007 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e27835b4-81dc-4fd1-baa9-98be98a02b0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28016 microversion: 2.20 time: 0.239917 Nov 09 04:58:06.437232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 149/295] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:06 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28016 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:06.754323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:06.755329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:06.774196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:06.775332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:06.775493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.777355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:06.780466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:06.785479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e0c9ebbe-fc4b-4b25-9171-b9c717ab911d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.430828 Nov 09 04:58:06.789436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 147/296] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:06 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:07.052879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:07.053568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:07.064922 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.065466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:07.066323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.066828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:07.112070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:07.119869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d682ab84-2a2f-4915-ab36-e77cc1a0ad65 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.370462 Nov 09 04:58:07.120837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 150/297] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:06 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:07.346560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:07.354754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-48b8d5a9-82c1-4330-8ac5-fade4c66324c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.305497 Nov 09 04:58:07.369052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 148/298] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:07 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:07.445445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:07.446680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:07.464376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.465108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:07.466905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.467554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:07.519224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-0501533a-e41f-40cf-9931-6a2882d315f4 req-850cd593-ff0e-453d-8fad-03d81cd3e6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8148a52-7fc3-4958-ac13-5a60c71c69ea", "tag": "3a90fc76-326e-43cd-a452-eed132093ac5"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:07.521497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:07.521497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:58:07.534848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-0501533a-e41f-40cf-9931-6a2882d315f4 req-850cd593-ff0e-453d-8fad-03d81cd3e6c6 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.535813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-0501533a-e41f-40cf-9931-6a2882d315f4 req-850cd593-ff0e-453d-8fad-03d81cd3e6c6 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:07.563763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-0501533a-e41f-40cf-9931-6a2882d315f4 req-850cd593-ff0e-453d-8fad-03d81cd3e6c6 service nova] Creating event network-changed:3a90fc76-326e-43cd-a452-eed132093ac5 for instance c8148a52-7fc3-4958-ac13-5a60c71c69ea on hv-cinder-81713 Nov 09 04:58:07.571687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-0501533a-e41f-40cf-9931-6a2882d315f4 req-850cd593-ff0e-453d-8fad-03d81cd3e6c6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055967 Nov 09 04:58:07.575954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 149/299] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:07.798189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b9a52ca0-8886-4103-b074-537ea1cb3b77 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28016 microversion: 2.20 time: 0.357854 Nov 09 04:58:07.799641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 151/300] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:07 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28016 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:07.807014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:07.808036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:07.816381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.817189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:07.818627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:07.819284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:08.140663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:08.141376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:08.153303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:08.153753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:08.154550 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:08.154986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:08.255204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:08.268039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4308ea97-08f8-4385-bec8-7fbb4374a863 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1522 microversion: 2.1 time: 0.464811 Nov 09 04:58:08.272007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 150/301] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:07 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:08.376434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:08.377056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:08.393197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:08.393721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:08.396890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:08.397354 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:08.433330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:08.442420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5f42e6f1-bc27-4528-8ec6-95cee894abf1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.307518 Nov 09 04:58:08.443016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 152/302] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:08 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:08.448857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1968400886", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f10e939-279a-4c85-98c6-1d5ee6c0218c"}], "security_groups": [{"name": "tempest-securitygroup--1697671709"}], "key_name": "tempest-keypair-457445519", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:08.625925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] validate_networks() for [('9f10e939-279a-4c85-98c6-1d5ee6c0218c', None, None, None, None, None)] {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:58:08.642207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:08.658097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fb00f518-4fd5-4b6a-9289-26ea039a069b tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.290088 Nov 09 04:58:08.658954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 151/303] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:08 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:08.812891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:08.813979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:08.821288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:08.821941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:08.822877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:08.823470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.097046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b58beddf-8463-4e07-8452-4595a438c40c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28089 microversion: 2.20 time: 0.287612 Nov 09 04:58:09.124578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 152/304] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:08 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28089 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:09.295388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:09.296279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:09.309872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.310922 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.312276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.313017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.486453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:58:09.486934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:58:09.487393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:58:09.487836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:58:09.488248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:58:09.504224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.504806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.506422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.507797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.547758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:09.552565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for user 07d92b2e7b1b46f6916c335b25a44ecf and project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:09.563151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:09.571971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-350b82d5-d413-4457-8f6c-560f7c55377a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1502 microversion: 2.1 time: 0.282204 Nov 09 04:58:09.572969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 153/305] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:09 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:09.577841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:09.578674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:09.585610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.586139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.586594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:58:09.587064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.587567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.589293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:58:09.647996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c9192f8b-d94c-4f84-9d13-a39356e54331 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.203867 Nov 09 04:58:09.649188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 153/306] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:58:08 2021] POST /compute/v2.1/servers => generated 402 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:58:09.653945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:09.654556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:09.661301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.661744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.662528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.662957 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.748633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:09.759235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c26b64bc-8689-4848-8222-1b352d0da635 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.182976 Nov 09 04:58:09.759235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 154/307] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:09 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:09.763956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a7811e6b-883e-48c5-aeb9-8cd343dd4577 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:09.764380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a7811e6b-883e-48c5-aeb9-8cd343dd4577 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:09.822788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a7811e6b-883e-48c5-aeb9-8cd343dd4577 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:09.829543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a7811e6b-883e-48c5-aeb9-8cd343dd4577 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1237 microversion: 2.1 time: 0.069123 Nov 09 04:58:09.830120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 155/308] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:09 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:09.855509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:09.857406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:09.861147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:09.871743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8df0a156-4e90-4490-8ddc-06483f444502 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1516 microversion: 2.1 time: 0.221194 Nov 09 04:58:09.872732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 154/309] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:09.874677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.875132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:09.875952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:09.876527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:10.095138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:10.116233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-942ed14e-cf10-4539-97ae-785dd37c01d1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.274465 Nov 09 04:58:10.117079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 156/310] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:09 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:10.136744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:10.138133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:10.147148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:10.148249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:10.149799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:10.151171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:10.774035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:10.774636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:10.780847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:10.781549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:10.782311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:10.782738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:10.914514 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:10.922309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0fa66508-ebf3-4264-8fa6-004f126cd1b4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.152007 Nov 09 04:58:10.922876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 157/311] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:10 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:10.939115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:10.939115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:10.943961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:10.944394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:10.945173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:10.945597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:11.003421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:11.010735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-62b6c3ae-95ee-4b47-9f6b-a53db2fe5337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1241 microversion: 2.1 time: 0.086933 Nov 09 04:58:11.011296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 158/312] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:10 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:11.132838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:11.133444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:11.139118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:11.139563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:11.140359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:11.140793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:11.269086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:11.276248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ffa6b3fa-1fb8-47d3-a2ef-bdb59d3f163f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.146883 Nov 09 04:58:11.276808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 159/313] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:11 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:11.940337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:11.941014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:11.947129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:11.947573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:11.948364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:11.948795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:12.081390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:12.088522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4d8220ca-ffc0-4065-a3a2-24769cb45c2f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.151838 Nov 09 04:58:12.089088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 160/314] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:11 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:12.093255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:12.093845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:12.099173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:12.099611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:12.100399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:12.100826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:12.158841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:12.165821 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-35eafed7-f543-4f38-9f8e-68cdef75d2cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1241 microversion: 2.1 time: 0.075810 Nov 09 04:58:12.166381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 161/315] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:12 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:12.296512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:12.297032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:12.303002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:12.303447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:12.304242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:12.304671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:12.433599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:12.441348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-970cd2f5-f4be-454c-818c-0e4c58988029 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.148740 Nov 09 04:58:12.441909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 162/316] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:12 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:13.105209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:13.106449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:13.112648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:13.113088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:13.113844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:13.114268 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:13.239507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:13.246719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-98410591-5dd7-4aa8-812d-f37ad1cc4651 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.145248 Nov 09 04:58:13.247285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 163/317] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:13 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:13.251445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:13.252067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:13.259374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:13.259855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:13.261079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:13.261659 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:13.323820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:13.331693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-609b2a98-d73b-4179-9253-22b007bba0e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1241 microversion: 2.1 time: 0.083436 Nov 09 04:58:13.332257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 164/318] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:13 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:13.457754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:13.458391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:13.464273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:13.464720 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:13.466124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:13.466561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:13.598565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:13.605762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f90ddb43-f68e-44d6-a674-945f0a7f1d28 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.151602 Nov 09 04:58:13.606316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 165/319] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:13 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:14.300868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:14.301536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:14.308901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d2a06d2e-09c0-4761-9183-caf8f4a45d85 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 4.177429 Nov 09 04:58:14.309448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:14.309599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 155/320] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:10 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 4180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:14.309701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:14.312398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:14.312398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:14.357594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:14.358213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:14.376903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:14.377351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:14.378141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:14.378575 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:14.439917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:14.447213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c4e539a6-c943-48bc-ae55-1fd2c7ed33ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1233 microversion: 2.1 time: 0.094299 Nov 09 04:58:14.448136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 156/321] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:14 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:14.462606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:14.470358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8e7be393-95d2-4a5c-b758-b459ab5461da tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.173182 Nov 09 04:58:14.470917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 166/322] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:14 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:14.622082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:14.622620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:14.628805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:14.629246 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:14.630010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:14.630441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:14.770441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:14.778467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0dad6ee8-0935-4b1d-afb6-5f6eeb853cc1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.159571 Nov 09 04:58:14.779031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 157/323] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:14 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:15.320755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:15.321712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:15.328542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.328979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.329733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.330160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.452379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3accf49c-6c79-45d1-b2b8-995c92ef3d69 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.135061 Nov 09 04:58:15.456240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 167/324] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:15 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:15.463828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:15.464430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:15.470718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.471161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.471971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.472385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.487384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:15.488372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:15.498256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.498974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.499900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.500246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.540588 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:15.549239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a0990531-4cfd-4eba-a24b-050b2d38b7f6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1297 microversion: 2.1 time: 0.088753 Nov 09 04:58:15.561781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 158/325] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:15 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:15.678736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:15.686882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-97c44d42-72ef-4de6-8660-be49c0c2b302 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.203622 Nov 09 04:58:15.692158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 168/326] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:15 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:15.797837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:15.798676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:15.804599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.805034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:15.806130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:15.806647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.011263 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:16.018598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7b19cbb9-eee9-4440-bbbd-af26506c2751 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.226308 Nov 09 04:58:16.019595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 159/327] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:15 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:16.463433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:16.464389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:16.471356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.471828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.472604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.473037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.575957 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:16.576819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:16.583173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.583637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.584620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.585057 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.793373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:16.800928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0eb326fd-a595-4923-8c94-068c528863c5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.236371 Nov 09 04:58:16.802084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 160/328] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:16 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:16.806608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-cff27cef-681e-4858-9f06-5e9d38cb78db req-f378f94d-05e4-4042-9fe9-673afe01d82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4587bfc-3272-4893-a25b-9e3cdbcd8f47", "name": "network-vif-plugged", "status": "completed", "tag": "ac852503-70fb-48a9-b3d8-4f2cac27b230"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:16.808204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:16.808204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:58:16.815185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-cff27cef-681e-4858-9f06-5e9d38cb78db req-f378f94d-05e4-4042-9fe9-673afe01d82d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.815639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-cff27cef-681e-4858-9f06-5e9d38cb78db req-f378f94d-05e4-4042-9fe9-673afe01d82d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.830501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-cff27cef-681e-4858-9f06-5e9d38cb78db req-f378f94d-05e4-4042-9fe9-673afe01d82d service nova] Creating event network-vif-plugged:ac852503-70fb-48a9-b3d8-4f2cac27b230 for instance f4587bfc-3272-4893-a25b-9e3cdbcd8f47 on hv-cinder-81713 Nov 09 04:58:16.835310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-cff27cef-681e-4858-9f06-5e9d38cb78db req-f378f94d-05e4-4042-9fe9-673afe01d82d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Nov 09 04:58:16.836092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 161/329] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:16.841040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:16.841776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:16.847697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.848148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:16.848933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:16.849363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.295101 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:17.302335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cd5961d2-fb7d-4e3c-bda7-c922118ed3bc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.465241 Nov 09 04:58:17.302915 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 162/330] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:16 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:17.307471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:17.308480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:17.314611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.315061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.315873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.316313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.338770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lazy-loading 'flavor' on Instance uuid 367541e4-c608-43b0-90da-677a42dc9b16 {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:58:17.451736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ac73af1d-f569-49fb-be48-2fbff0f819e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action" status: 200 len: 32 microversion: 2.1 time: 0.147588 Nov 09 04:58:17.452408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 163/331] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:17 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:17.458064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:17.458971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:17.466219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.466661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.467440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.467887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.608871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:17.616135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-99c32737-43ca-4a17-884d-3b1dde407abf tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.162526 Nov 09 04:58:17.616707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 164/332] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:17 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:17.621002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-e602305b-0092-4715-8bc3-938f0abeeb8a req-3db8f21c-dadd-4c1a-8ea4-3070b145b4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3364cb-1695-4329-82ff-d4e26da28b73", "tag": "1a56d5b6-a073-45bb-a202-4b929f0d7b30"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:17.622516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:17.622516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:58:17.629063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-e602305b-0092-4715-8bc3-938f0abeeb8a req-3db8f21c-dadd-4c1a-8ea4-3070b145b4a1 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.629509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-e602305b-0092-4715-8bc3-938f0abeeb8a req-3db8f21c-dadd-4c1a-8ea4-3070b145b4a1 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.640304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-e602305b-0092-4715-8bc3-938f0abeeb8a req-3db8f21c-dadd-4c1a-8ea4-3070b145b4a1 service nova] Creating event network-changed:1a56d5b6-a073-45bb-a202-4b929f0d7b30 for instance 3a3364cb-1695-4329-82ff-d4e26da28b73 on hv-cinder-81713 Nov 09 04:58:17.644826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-e602305b-0092-4715-8bc3-938f0abeeb8a req-3db8f21c-dadd-4c1a-8ea4-3070b145b4a1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027034 Nov 09 04:58:17.645383 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 165/333] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:17.650009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:17.650690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:17.657160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.657560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.658324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.658760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.784519 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:17.791688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-43decb5a-bb62-4dde-8fef-7cec941651a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.145179 Nov 09 04:58:17.792252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 166/334] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:17.817491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:17.818092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:17.824144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.824627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.825422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:17.825864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:17.953350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:17.960663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d40dc0af-9be7-4d19-9fe6-4de2f817a726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.146545 Nov 09 04:58:17.961222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 167/335] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:17 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:18.318380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:18.318972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:18.325547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.325986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.326740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.327164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.457169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:18.464271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d8d1ead1-08ad-4994-8275-04b99fde7d62 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.149480 Nov 09 04:58:18.464836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 168/336] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:18 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:18.632479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:18.633114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:18.639747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.640200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.641987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.642453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.768059 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:18.775178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f16451a6-64fa-441f-b402-9b8622071162 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.146324 Nov 09 04:58:18.775769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 169/337] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:18 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:18.808540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:18.809650 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:18.815159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.815601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.816385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.816810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.948654 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:18.956487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-17c6768b-6dfd-481d-8665-e937ffe8097f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.151359 Nov 09 04:58:18.957046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 170/338] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:18.977063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:18.977660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:18.983322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.983799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:18.984565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:18.984998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:19.110092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:19.117145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1589be73-c326-4f11-81a2-44ee16feb0b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.143676 Nov 09 04:58:19.117813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 171/339] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:18 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:19.481815 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:19.482417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:19.488623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:19.489066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:19.489836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:19.490265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:19.616670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:19.623892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c2bc9671-29dd-4670-b4f7-57079a5172d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.146203 Nov 09 04:58:19.624455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 172/340] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:19 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:19.792642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:19.793264 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:19.799750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:19.800193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:19.800948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:19.801373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:19.930683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:19.938058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2bf7bf1c-c7b8-4c1f-b43d-105cc58a5c6a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.149209 Nov 09 04:58:19.938617 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 173/341] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:19 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:19.972694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:19.973283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:19.978788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:19.979229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:19.980020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:19.980446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:20.107269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:20.114407 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-26b23bb1-fa5e-41fd-ab85-cd909fb92b70 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.145066 Nov 09 04:58:20.114967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 174/342] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:20.133347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:20.133940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:20.139872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:20.140309 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:20.141066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:20.141490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:20.269703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:20.276785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a2302f6-b9c9-4fba-981e-4cb7288d3f0e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.146703 Nov 09 04:58:20.277341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 175/343] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:20 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:20.468419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b23c0423-60d8-4fa2-9437-d710542ea273 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 4.008554 Nov 09 04:58:20.469848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 169/344] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:16 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 4010 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:20.641541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:20.642147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:20.648373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:20.648817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:20.649620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:20.650655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:20.954661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:20.955496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:20.962402 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:20.962848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:20.963646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:20.964093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:21.036122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:21.046858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4698bc32-17dd-4ec2-a046-fde800dcfbc0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.406261 Nov 09 04:58:21.047739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 176/345] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:20 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:21.111213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:21.118443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a0332853-3996-4e17-9c5a-137ca1109e11 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.167665 Nov 09 04:58:21.119011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 170/346] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:20 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:21.133135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:21.133734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:21.140378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:21.140893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:21.141693 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:21.142122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:21.268769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:21.275939 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-39e11378-ca0e-4f88-afe9-34a425e43d64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.146352 Nov 09 04:58:21.276491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 177/347] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:21.293855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:21.294454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:21.300601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:21.301037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:21.301793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:21.302214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:21.435589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:21.443097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-afffd195-5de3-4ac0-8328-3e8b3fd8b281 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.152942 Nov 09 04:58:21.443660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 171/348] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:21 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:21.479867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:21.481321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:21.487257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:21.487850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:21.488615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:21.489044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.070298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:22.070298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:22.074677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.075119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.075986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.076423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.212040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:22.219798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-516b2a90-b5f7-421d-89e9-3f43b76b740b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.159328 Nov 09 04:58:22.220366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 172/349] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:22 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:22.224644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:22.225237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:22.230775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.231220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.232023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.232451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.361357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:22.368535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-78b293f9-0708-4340-8029-f3a04a6f9eb7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.147236 Nov 09 04:58:22.369187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 173/350] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:22 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:22.374219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:22.374985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:22.375832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d45599e0-ade4-4c0c-8057-4f6ebcbb98dd tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.899426 Nov 09 04:58:22.377271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 178/351] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:21 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:22.380996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.381498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.382265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.382694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.460141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:22.460835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:22.476463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.476910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.477699 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:22.478134 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:22.531536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:22.539572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c22a82ee-7927-44b1-b479-f19532be3bde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.169202 Nov 09 04:58:22.540089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 174/352] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:22.796644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:22.803954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0561e21b-f0a0-4a38-9c3f-8a982f16e959 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.347717 Nov 09 04:58:22.804525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 179/353] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:22 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:23.236303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:23.236929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:23.243215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.243690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.244457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.244937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.372984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:23.380813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-309913ec-74a8-464e-a0ad-21067ee13c03 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.148140 Nov 09 04:58:23.381538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 175/354] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:23 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:23.384684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:23.385434 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:23.387605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:23.388739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:23.394377 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.394566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.394834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.395007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.395833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.396221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.396315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.396924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.526323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:23.533723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bb8d8fe9-eb1b-4278-892b-f1dc19e7fb81 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.152828 Nov 09 04:58:23.534277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 180/355] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:23 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:23.555432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:23.556050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:23.562478 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.563092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.563896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.564327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.691233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:23.698386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b5a73666-1079-4b36-8574-58ba29b69c8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.146370 Nov 09 04:58:23.698941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 181/356] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:23.819440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:23.820059 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:23.825754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.826194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.826947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:23.827375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:23.951468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:23.958557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c73ef64-ca0a-4ee5-9999-2e83bbc7e726 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.142591 Nov 09 04:58:23.959113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 182/357] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:23 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:24.398088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:24.398729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:24.405141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.405586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.406611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.407045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.535378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:24.542576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a58e9c0f-0808-4712-9a9c-808fab1b7779 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.148166 Nov 09 04:58:24.543642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 183/358] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:24 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:24.549329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:24.549935 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:24.555591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.556076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.556852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.557285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.684596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:24.692704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4857272a-b83d-4574-a697-27763c84312a tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.146589 Nov 09 04:58:24.693267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 184/359] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:24 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:24.713428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:24.714014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:24.719516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.720020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.720777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.721201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.850744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:24.858509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e4e193bc-5574-4510-b933-7943f0677735 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.148433 Nov 09 04:58:24.859068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 185/360] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:24.974512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:24.975112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:24.981932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.982381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:24.983159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:24.983593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:25.107960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:25.115109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-62f294c4-6cce-4c08-81cb-28bcabc0718e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.144107 Nov 09 04:58:25.115696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 186/361] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:24 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:25.560791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:25.561444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:25.567221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:25.567684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:25.568453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:25.568875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:25.697995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:25.706042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-05d4ba65-bcec-469b-b129-a0b4d73f6237 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.149472 Nov 09 04:58:25.706608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 187/362] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:25 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:25.710773 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:25.711359 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:25.717022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:25.717465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:25.718226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:25.718653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:25.845319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:25.852576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7d0768da-7055-41d1-a957-01f8393d48d6 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.145023 Nov 09 04:58:25.853148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 188/363] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:25 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:25.875140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:25.875764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:25.881174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:25.881615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:25.882372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:25.882803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:26.010853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:26.022001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4642104c-3523-4726-ab9d-ebe1e3008cee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.150678 Nov 09 04:58:26.022567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 189/364] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:26.131330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:26.131954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:26.137636 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:26.138073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:26.138837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:26.139271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:26.268520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:26.275792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c08adfde-7c43-4b31-990b-43350c64cb1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.147909 Nov 09 04:58:26.276656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 190/365] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:26 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:26.722046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:26.722675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:26.728605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:26.729050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:26.729817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:26.730247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:26.855896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:26.863078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-03098e8f-ecfa-4226-b29c-88c9441e10a5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.144647 Nov 09 04:58:26.863844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 191/366] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:26 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:26.868812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:26.869410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:26.874869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:26.875311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:26.876107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:26.876535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:27.004682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:27.012294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b9fabcf3-d51f-49c4-9847-71ca1d555330 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.146268 Nov 09 04:58:27.012859 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 192/367] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:26 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:27.037416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:27.038009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:27.043615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:27.044088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:27.044852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:27.045292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:27.170213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:27.177401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-268acef6-3d26-41b6-a905-848ceafb36ca tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.143305 Nov 09 04:58:27.177965 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 193/368] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:27.293397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:27.293996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:27.299880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:27.300328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:27.301097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:27.301529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:27.432847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:27.440833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5a1eb628-0438-4b57-ae89-f8f0bc107dfe tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.151068 Nov 09 04:58:27.441406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 194/369] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:27 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:27.879611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:27.880239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:27.886023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:27.886408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:27.887179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:27.887609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.026152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:28.034419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3020c0cb-20d4-473e-bb3b-882c4b578689 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.158513 Nov 09 04:58:28.034974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 195/370] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:27 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:28.039089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:28.039699 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:28.045625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:28.046072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.046837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:28.047266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.174420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:28.181844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-02c5a5ae-5796-41c2-8fec-39194ad0400f tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.145935 Nov 09 04:58:28.182405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 196/371] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:28 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:28.193585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:28.194171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:28.200199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:28.200639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.201398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:28.201821 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.338205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:28.346150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1dd45d1a-df24-474f-b5a0-bd91aa7cd433 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.156027 Nov 09 04:58:28.346744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 197/372] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:28.457442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:28.457969 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:28.463783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:28.464229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.465619 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:28.466073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:28.568472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ca4cee80-343f-4b74-8c67-e7d97eb65544 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 5.184817 Nov 09 04:58:28.572475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 176/373] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:23 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 5187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:28.594558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:28.601674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-746b6d19-ab74-4a7f-8377-0c25d9284dca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.147982 Nov 09 04:58:28.602233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 198/374] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:28 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:29.051881 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:29.052570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:29.059914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.060367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.061137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.061572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.190526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:29.198014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:29.198622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:29.200301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-67216c22-b0cd-445e-95ab-3d99786ba880 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1318 microversion: 2.1 time: 0.152541 Nov 09 04:58:29.200874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 177/375] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:29 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:29.205412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.205862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.206705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.207148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.352570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:29.362073 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:29.362679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:29.369077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c41941ce-0104-4983-b683-2719e738dcef tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.174671 Nov 09 04:58:29.369659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 199/376] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:29 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:29.374063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.374512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.375379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.376025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.530015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:29.538445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4894e144-6b94-4992-9bf2-9ec8f021cfff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.180259 Nov 09 04:58:29.539025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 178/377] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:29.580766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:29.586123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:29.598412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.600568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.602756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.603189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.619642 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:29.621602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:29.628560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.629852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.632127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:29.632743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:29.767217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:29.774647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bce512c1-c0c4-489e-bbe4-9de51d9aa0cd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.160251 Nov 09 04:58:29.775361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 179/378] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:29 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:29.906576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f09cec97-eff9-4a16-a67e-0cfb750d5f0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.329315 Nov 09 04:58:29.907755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 200/379] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:29 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:30.218071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:30.218581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.225017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.225464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.226270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.226690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.358957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:30.366629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7edbf3c0-1888-4be0-9d5a-641aa545b19f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1508 microversion: 2.1 time: 0.153191 Nov 09 04:58:30.367195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 180/380] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:30 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:30.383816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4155b26a-8569-410c-94f5-feee61196157"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:30.384961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.385961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:30.387064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.392402 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.392734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.392867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.393175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.393607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.393932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.394032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.394394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.471934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] HTTP exception thrown: Invalid volume: volume 4155b26a-8569-410c-94f5-feee61196157 is already attached to instances: 12e7964e-3c1d-4928-9dfa-399d3721c871 Nov 09 04:58:30.472463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Returning 400 to user: Invalid volume: volume 4155b26a-8569-410c-94f5-feee61196157 is already attached to instances: 12e7964e-3c1d-4928-9dfa-399d3721c871 {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:58:30.473299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f09deda0-77a2-4370-88dd-03f38a9c3087 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094117 Nov 09 04:58:30.474000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 201/381] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:58:30 2021] POST /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 04:58:30.528072 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:30.531310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:30.531844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.538643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.539089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.539259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aa990616-9fc6-4d8e-a1f8-577c6ae6bce5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.156465 Nov 09 04:58:30.539899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.540329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.540417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 181/382] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:30 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:30.556591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:30.557199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.564375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.565193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.566595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.567378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.675538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lazy-loading 'services' on Instance uuid 12e7964e-3c1d-4928-9dfa-399d3721c871 {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:58:30.726863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:30.738365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ed79ff8d-66ea-4526-9d18-eb93d46433be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.185615 Nov 09 04:58:30.738934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 182/383] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:30.791596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:30.792429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.799496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.799965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.800074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cceb98d1-76d6-4815-91a1-13193d032d56 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments/4155b26a-8569-410c-94f5-feee61196157" status: 202 len: 0 microversion: 2.1 time: 0.272747 Nov 09 04:58:30.800556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 202/384] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 04:58:30 2021] DELETE /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments/4155b26a-8569-410c-94f5-feee61196157 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:30.804036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.804485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.823556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:30.829294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.835789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.836246 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.837035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.837467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.876656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5bc503f0-7435-402c-a077-79b4a44e41e1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070715 Nov 09 04:58:30.877610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 203/385] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:30 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:30.918505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:30.919423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:30.925905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.926356 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.927144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:30.927578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:30.975896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:30.989864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-267f5b37-b4d7-4371-9aa3-757e4219de1c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.202078 Nov 09 04:58:30.990710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 183/386] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:30 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:31.172976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-71af8390-3c94-449d-8ec0-4ac96fc58f49 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.257972 Nov 09 04:58:31.175647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 204/387] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:30 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:31.560729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:31.561334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:31.568305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:31.568721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:31.569693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:31.570341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:31.736019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:31.745061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c8e31149-69e1-4df5-b8cc-9f8b78f5c00c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.187791 Nov 09 04:58:31.756224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 184/388] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:31 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:31.758346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:31.759162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:31.767826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:31.768449 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:31.769978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:31.770708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:31.890396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:31.892623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:31.904727 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:31.905408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:31.907522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:31.908137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:31.927889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:31.938069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fed0fe42-e949-4b7b-9397-fa7e9aa42173 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.184244 Nov 09 04:58:31.938851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 205/389] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:31.959148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-faf407df-7a64-499e-bce5-e2684189e57c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075080 Nov 09 04:58:31.959885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 185/390] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:31 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:32.006791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:32.007715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-e49306ff-3387-4c4a-be90-82d57c663dfd req-ab6ccf22-0fa8-4dc8-abe2-b95d9446a1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8148a52-7fc3-4958-ac13-5a60c71c69ea", "name": "network-vif-plugged", "status": "completed", "tag": "3a90fc76-326e-43cd-a452-eed132093ac5"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:32.007880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:32.009506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:32.009506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:58:32.014539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.015277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.016381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.017027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.018894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-e49306ff-3387-4c4a-be90-82d57c663dfd req-ab6ccf22-0fa8-4dc8-abe2-b95d9446a1ee service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.019336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-e49306ff-3387-4c4a-be90-82d57c663dfd req-ab6ccf22-0fa8-4dc8-abe2-b95d9446a1ee service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.033475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-e49306ff-3387-4c4a-be90-82d57c663dfd req-ab6ccf22-0fa8-4dc8-abe2-b95d9446a1ee service nova] Creating event network-vif-plugged:3a90fc76-326e-43cd-a452-eed132093ac5 for instance c8148a52-7fc3-4958-ac13-5a60c71c69ea on hv-cinder-81713 Nov 09 04:58:32.039007 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-e49306ff-3387-4c4a-be90-82d57c663dfd req-ab6ccf22-0fa8-4dc8-abe2-b95d9446a1ee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036951 Nov 09 04:58:32.039907 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 206/391] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:32.185641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:32.187004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:32.188247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:32.193797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.194609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.195579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.196874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.202582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-15a58c22-9b9b-4977-bd3f-8ca6fc0d0c44 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.198962 Nov 09 04:58:32.203174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 186/392] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:32 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:32.346360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6c66af0c-1d28-457e-b2c3-d89010afdd2a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.164819 Nov 09 04:58:32.350152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 207/393] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:32 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:32.765960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:32.767212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:32.780184 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.780643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.781815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.782259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.929045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:32.936256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-279c4160-ce77-4d59-bbe7-1c023ba5b722 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.174520 Nov 09 04:58:32.936939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 187/394] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:32 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:32.956893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:32.957712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:32.965994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.966458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.967246 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.968049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.971693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:32.972730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:32.981231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.981884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:32.982719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:32.983339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:33.019496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-85b10b36-d037-46f0-abcf-787cba9b355b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052120 Nov 09 04:58:33.020500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 188/395] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:32 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:33.143602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:33.151734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-601467eb-f974-452a-bcf2-b139e46855b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.198852 Nov 09 04:58:33.152561 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 208/396] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:33.220104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:33.221275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:33.228730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:33.229377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:33.231076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:33.231808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:33.361260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:33.362190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:33.378014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:33.378525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:33.379266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:33.379814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:33.392625 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:33.400314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-90859933-675d-48de-a979-e972e46b2187 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.184236 Nov 09 04:58:33.402461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 189/397] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:33 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:33.952905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:33.953506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:33.959531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:33.960003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:33.960765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:33.961191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.090543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:34.097899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b44753f5-0b97-4c12-970c-742e453d91e5 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.149300 Nov 09 04:58:34.098510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 190/398] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:33 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:34.102909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:34.103914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:34.109285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:34.109723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.110476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:34.110903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.139859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4bbff443-06aa-49ee-abc4-998152f33390 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040294 Nov 09 04:58:34.140407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 191/399] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:34 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:34.168968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:34.169549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:34.175065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:34.175504 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.176296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:34.176722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.301500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:34.309657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4e2721ac-df7b-4096-b358-6e5e1e659a1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.144570 Nov 09 04:58:34.310236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 192/400] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:34.418850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:34.419454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:34.425598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:34.426297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.427153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:34.427584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:34.457056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2fd8fc6a-c8c4-47df-97bb-14a902658ed7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 1.102130 Nov 09 04:58:34.461079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 209/401] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:33 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:34.558083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:34.565347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-010adcda-9f83-4a78-873c-352583e993c3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.150954 Nov 09 04:58:34.565903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 193/402] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:34 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:35.115484 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:35.116203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:35.122971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.123409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.124205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.124639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.150069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:35.151019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:35.158091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.158534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.159293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.159743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.188203 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-619c64a2-bf7a-4989-8af7-be2d08118634 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Nov 09 04:58:35.192084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 194/403] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:35 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:35.251876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:35.260013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-199d8a53-816b-41c0-a1e8-a65521c8bb0c tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1312 microversion: 2.1 time: 0.148411 Nov 09 04:58:35.260770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 210/404] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:35 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:35.326630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:35.327222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:35.333056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.333500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.334262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.334694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.465300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:35.468817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:35.469785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:35.472683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b43d8975-5eaf-46a8-9dc4-5436fa4c649f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.150172 Nov 09 04:58:35.473249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 195/405] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:35.475970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.476412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.477208 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.477629 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.582279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:35.582915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:35.588730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.589180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.589970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.590399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.641231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-656f10db-f1e3-4c6d-b871-8a58d3d93262 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.175940 Nov 09 04:58:35.642268 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 211/406] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:35 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:35.721002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:35.728357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0974df0-53ac-4177-a5e8-6c1561cd2bfb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.149689 Nov 09 04:58:35.729149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 196/407] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:35 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:35.770510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-8a628425-7c02-4738-b161-57bec8539fe6 req-987363e0-b000-4f91-b774-23dd15d1927f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3364cb-1695-4329-82ff-d4e26da28b73", "name": "network-vif-plugged", "status": "completed", "tag": "1a56d5b6-a073-45bb-a202-4b929f0d7b30"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:35.772127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:35.772127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:58:35.780163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-8a628425-7c02-4738-b161-57bec8539fe6 req-987363e0-b000-4f91-b774-23dd15d1927f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:35.780610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-8a628425-7c02-4738-b161-57bec8539fe6 req-987363e0-b000-4f91-b774-23dd15d1927f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:35.792010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-8a628425-7c02-4738-b161-57bec8539fe6 req-987363e0-b000-4f91-b774-23dd15d1927f service nova] Creating event network-vif-plugged:1a56d5b6-a073-45bb-a202-4b929f0d7b30 for instance 3a3364cb-1695-4329-82ff-d4e26da28b73 on hv-cinder-81713 Nov 09 04:58:35.797384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-8a628425-7c02-4738-b161-57bec8539fe6 req-987363e0-b000-4f91-b774-23dd15d1927f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 Nov 09 04:58:35.798400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 212/408] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:36.199913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:36.200829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:36.206975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.207419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.208283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.208715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.236586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bfea8631-62ac-4efc-af8f-36fdb4d4d4cd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041153 Nov 09 04:58:36.237134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 197/409] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:36 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:36.277588 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:36.278269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:36.285343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.285808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.286872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.287303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.415583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:36.423222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fe37f7e5-dc57-4922-94ae-093caba40d85 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1496 microversion: 2.1 time: 0.149646 Nov 09 04:58:36.423809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 213/410] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:36 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:36.489079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:36.489685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:36.495325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.496372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.497144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.497593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.632240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:36.639465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-68a5b6d1-16c9-45dd-a740-39fc5078f635 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.154006 Nov 09 04:58:36.640063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 198/411] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:36.652813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:36.653754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:36.660615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.661149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.662375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.662901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.745343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:36.745939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:36.751984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.752424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.753178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:36.753602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:36.763784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-16e851bb-58b5-4dc6-9703-589d9240d537 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.114439 Nov 09 04:58:36.764439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 214/412] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:36 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:36.881223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:36.888402 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d22ba2ed-d326-4f24-8101-99f6a8410b32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.146618 Nov 09 04:58:36.888970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 199/413] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:36 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:37.249163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:37.250311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:37.257335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.257784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.258611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.259010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.291219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d505afd4-7a92-47d2-b8de-df2b31a98dad tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Nov 09 04:58:37.295402 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 215/414] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:37 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:37.656957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:37.657665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:37.663964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.664431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.665201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.665636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.775775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:37.776738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:37.783937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.784374 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.785142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.785569 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.791266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:37.799084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76d99f31-6f73-4f4d-90d3-700bfee6b513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.146008 Nov 09 04:58:37.799665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 200/415] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:37.905379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:37.906234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:37.912081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.912529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:37.913294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:37.913726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:38.042540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:38.049805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ee4bc235-cd18-41c0-8538-9e93456bd742 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.148769 Nov 09 04:58:38.050373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 201/416] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:37 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:38.302320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:38.303155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:38.309539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:38.309981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:38.310736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:38.311181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:38.339249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c2b15f64-c2b3-41df-a0e2-a4b0229ef654 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040750 Nov 09 04:58:38.339827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 202/417] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:38 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:38.817119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:38.817738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:38.824002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:38.824381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:38.825132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:38.825552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:38.949675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:38.956917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e189035d-3f80-4268-bdec-619a671c401a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.143426 Nov 09 04:58:38.957484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 203/418] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:39.065594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:39.066189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:39.071962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:39.072398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:39.073238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:39.073781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:39.200929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:39.208048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0eec1519-7667-4848-abd8-7cdb48a22b82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.146072 Nov 09 04:58:39.208605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 204/419] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:39 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:39.350191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:39.351120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:39.357489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:39.357933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:39.358699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:39.359133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:39.387420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-488885fa-b7ff-4eac-b142-b57de00787ae tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040850 Nov 09 04:58:39.387996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 205/420] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:39 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:39.972721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:39.973328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:39.979708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:39.980157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:39.980924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:39.981365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:40.106960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:40.119004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bbcc9162-c613-4489-bb27-ea15b348cb58 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.149870 Nov 09 04:58:40.119576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 206/421] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:40.224234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:40.224831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:40.230969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:40.231416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:40.232207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:40.232651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:40.359652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:40.366751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-505ddeb9-06ff-41d6-9bae-6904240a7ac0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.145939 Nov 09 04:58:40.367321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 207/422] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:40 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:40.397783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:40.398675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:40.404293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:40.404738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:40.405505 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:40.406201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:40.435254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3008bb05-ec18-4970-93e3-e02d86003660 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040900 Nov 09 04:58:40.435818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 208/423] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:40 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:40.919269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5198f54e-e968-4aea-936c-8f3fe5bdb039 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 3.147222 Nov 09 04:58:40.920641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 216/424] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:37 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 3149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:41.136703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:41.137310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:41.143863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.144314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.145083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.145519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.271401 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:41.279438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4e7138db-0e0a-4a8d-8fdd-58815278c5c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.146859 Nov 09 04:58:41.280036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 209/425] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:41.388919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:41.390904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:41.402808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.403538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.404809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.405481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.447684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:41.448584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:41.455785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.456224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.457302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.457942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.490137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-20a79f57-1198-4cec-8901-bc67943f6676 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Nov 09 04:58:41.490711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 210/426] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:41 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:41.601390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:41.601867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:41.607881 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.608328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.609100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.609531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.643010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:41.643592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 04:58:41.653083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f5bc2341-c0d7-477f-a2ee-d0b82e08b53e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.270927 Nov 09 04:58:41.655968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 217/427] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:41 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:41.741478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-724cf138-e584-4309-8a43-c0ab32727c20 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 204 len: 0 microversion: 2.1 time: 0.145870 Nov 09 04:58:41.742388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 211/428] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 04:58:41 2021] DELETE /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 09 04:58:41.751075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:41.751727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:41.758300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.758815 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.759603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.760154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.931085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:41.932025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:41.938825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.939269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:41.940085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:41.940511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.043418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fe745b8d-5bc1-4096-ac0d-c56e7e589f21 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.115761 Nov 09 04:58:42.047486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 212/429] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:41 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:42.202233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:42.209446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c3c2f0bd-95bc-4a0b-9f1e-f7daa37ec0b7 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1502 microversion: 2.1 time: 0.462316 Nov 09 04:58:42.210008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 218/430] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:41 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:42.296911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:42.297638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:42.304455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:42.304906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.305679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:42.306109 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.436558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:42.444388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e37bb389-7e18-42dc-8447-96745d3c70c0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.152223 Nov 09 04:58:42.444960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 213/431] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:42.501747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:42.502597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:42.508473 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:42.508919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.509689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:42.510212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.543427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-224a74b9-63b3-427d-a02a-f7a4a7df9eb8 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Nov 09 04:58:42.544091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 219/432] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:42 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:42.675677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:42.675677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:42.684196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:42.684832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.685639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:42.686064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:42.821638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:42.829380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f933fe8-7dac-47f9-9aa2-044a334e5d55 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1363 microversion: 2.1 time: 0.161526 Nov 09 04:58:42.829951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 214/433] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:42 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:43.054076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:43.055017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:43.061300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.061763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.062562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.063079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.121163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1777906243", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "c9c7c7bf-a974-401b-8934-eb01fbeb899e"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:43.174579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] validate_networks() for [('c9c7c7bf-a974-401b-8934-eb01fbeb899e', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:58:43.220453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f5ff25ca-6e0c-4ab3-8613-19f38595343f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.169858 Nov 09 04:58:43.222427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 220/434] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:43 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:43.227930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:43.228611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:43.236138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.236878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.238070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.238070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.379794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:43.387319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2269414c-0a2c-4320-aa67-d2744a1cd50e tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1502 microversion: 2.1 time: 0.163243 Nov 09 04:58:43.396736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 221/435] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:43 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:43.461997 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:43.462782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:43.469866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.470361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.471533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.472023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.616141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:43.624027 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-eb187d3d-7a92-4080-b612-cafec6bb9bb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.165818 Nov 09 04:58:43.624613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 222/436] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:43.629121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:43.630087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:43.636092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.636541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.637353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.637784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.668195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-58b0f9e4-02ca-4143-9e6c-5e1d0c399a4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041842 Nov 09 04:58:43.668757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 223/437] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:58:43 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:43.706456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:58:43.706924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:58:43.707471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:58:43.707986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:58:43.708286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:58:43.717228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.717663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.718448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.718869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.735008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Getting quotas for project 79869bd25d3c47ca87597d1801b9d710. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:43.739391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Getting quotas for user e4b8ce2b334d42c8bf0196e992180e0f and project 79869bd25d3c47ca87597d1801b9d710. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:43.749720 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:58:43.752209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:58:43.799477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0d14bd7f-262f-4b13-8a70-6a54ad7585f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682544 Nov 09 04:58:43.800319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 215/438] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:58:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 04:58:43.811170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7905af13-37a8-4629-9d3c-4fde091f7f74 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:43.811841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7905af13-37a8-4629-9d3c-4fde091f7f74 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:43.827435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-654966629", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "9dc74574-bcbe-4d7d-85c6-61611faf1df6"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:43.887332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] validate_networks() for [('9dc74574-bcbe-4d7d-85c6-61611faf1df6', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:58:43.896086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7905af13-37a8-4629-9d3c-4fde091f7f74 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:43.902830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7905af13-37a8-4629-9d3c-4fde091f7f74 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1219 microversion: 2.1 time: 0.096666 Nov 09 04:58:43.907546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 224/439] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:43 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:43.908228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:43.908828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:43.914933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.915341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:43.916161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:43.916580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.064740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:44.074120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f02a28b3-f049-43e3-8b8d-3df9edcce262 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1550 microversion: 2.1 time: 0.167865 Nov 09 04:58:44.084671 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 225/440] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:43 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:44.095322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:44.095322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:44.102627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.103217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.104489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.105562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.208194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-92f72dc6-6d7a-4680-82ab-491d8b38f715 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119864 Nov 09 04:58:44.208852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 226/441] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Nov 9 04:58:44 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:44.232898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:44.234461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:44.241104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.241770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.242732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.244065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.387277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-10803d15-f1b0-4a57-a3cd-116c8ce6e43e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.158650 Nov 09 04:58:44.389249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 227/442] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:44 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:44.400882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:58:44.401331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:58:44.402341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:58:44.402752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:58:44.403151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:58:44.412706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.413242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.414257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.415019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.416959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:44.418438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:44.433116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.433672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.434558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.436792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:44.438273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.441663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for user 2dc41f90272e4a549aad1634f08342a6 and project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:44.455494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:58:44.458117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:58:44.513920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-072f0e6d-cf1b-46d4-8326-7f9b5433f001 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690935 Nov 09 04:58:44.514855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 216/443] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:58:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 04:58:44.524552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-be979912-ff23-4b92-9fc4-148dd3856462 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:44.525154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-be979912-ff23-4b92-9fc4-148dd3856462 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:44.584227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-be979912-ff23-4b92-9fc4-148dd3856462 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:44.591682 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-be979912-ff23-4b92-9fc4-148dd3856462 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1217 microversion: 2.1 time: 0.070629 Nov 09 04:58:44.592913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 217/444] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:44 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:44.643069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:44.644391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:44.653423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.654136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.655127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.656135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.833587 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:44.843048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3a19f972-6702-4a68-b7a8-280c114d05af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.205245 Nov 09 04:58:44.844510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 218/445] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:44.858711 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:44.870266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1f6ea5a7-39da-4fad-9abe-c4aa542fcadc tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1502 microversion: 2.1 time: 0.467526 Nov 09 04:58:44.871934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 228/446] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:44 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1502 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:44.919946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:44.920879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:44.927076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.927845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:44.928886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:44.929379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:45.015014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:45.023096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e0ee91ae-47f6-4218-8054-2a9434ddeefd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1271 microversion: 2.1 time: 0.107056 Nov 09 04:58:45.023905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 219/447] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:45.403259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:45.404684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:45.413187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:45.414203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:45.415224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:45.415690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:45.611771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:45.612758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:45.619456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:45.619866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:45.620647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:45.621073 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:45.979037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-84963293-fce8-4098-987b-b8a91a1def4d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 0.371227 Nov 09 04:58:45.979848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 220/448] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:45 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:45.984817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:45.985565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:45.992885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:45.993331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:45.994107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:45.994542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.012517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-78ec3401-a109-4b23-b4fe-d03fe0b72f09 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.615539 Nov 09 04:58:46.016507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 229/449] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:45 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:46.023423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-c8552ee3-6e91-4601-a41d-1d1491c7ef74 req-737b9fbf-7a7e-485f-8c1f-4b1861546a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3364cb-1695-4329-82ff-d4e26da28b73", "tag": "1a56d5b6-a073-45bb-a202-4b929f0d7b30"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:46.025292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:46.025292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:58:46.042174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-c8552ee3-6e91-4601-a41d-1d1491c7ef74 req-737b9fbf-7a7e-485f-8c1f-4b1861546a1f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.042754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-c8552ee3-6e91-4601-a41d-1d1491c7ef74 req-737b9fbf-7a7e-485f-8c1f-4b1861546a1f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.059532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-c8552ee3-6e91-4601-a41d-1d1491c7ef74 req-737b9fbf-7a7e-485f-8c1f-4b1861546a1f service nova] Creating event network-changed:1a56d5b6-a073-45bb-a202-4b929f0d7b30 for instance 3a3364cb-1695-4329-82ff-d4e26da28b73 on hv-cinder-81713 Nov 09 04:58:46.066019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-c8552ee3-6e91-4601-a41d-1d1491c7ef74 req-737b9fbf-7a7e-485f-8c1f-4b1861546a1f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050319 Nov 09 04:58:46.068354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 230/450] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:46.071519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:46.076958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:46.078119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:46.083478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-453c9a3b-7187-457b-b012-78d55aa17c77 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1213 microversion: 2.1 time: 0.102389 Nov 09 04:58:46.084391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 221/451] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:45 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:46.089992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:46.090930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:46.091947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.093781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.094827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.096384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.099128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.099974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.101140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.103207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.277925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:46.288542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-df1b1a85-965d-4103-9ef3-703522f85bed tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1502 microversion: 2.1 time: 0.202678 Nov 09 04:58:46.291349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 222/452] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:46 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:46.305217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:46.305951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:46.324544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.324983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.326616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.327217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.407926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:46.416347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2c4451dc-def3-49e5-a6d6-a0ce03e4a99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1277 microversion: 2.1 time: 0.121744 Nov 09 04:58:46.417119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 223/453] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:46 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:46.944899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:46.955261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-15eb16b3-fdb8-45d1-894b-6779b241bf0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1522 microversion: 2.1 time: 0.884789 Nov 09 04:58:46.956120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 231/454] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1522 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:46.990207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:46.991396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:46.997825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.998272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:46.999058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:46.999492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.025786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:47.027415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:47.039674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.041216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.042023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.043165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.250994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a8885b4-6b5a-4331-857c-cf060cb89686 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.230367 Nov 09 04:58:47.252358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 232/455] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:47 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:47.257583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:47.258272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:47.265858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.266838 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.268009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.268599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.270516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a1bd5e28-e063-42bd-a7d1-74e0bf69b4c0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 0.283812 Nov 09 04:58:47.273766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 224/456] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:46 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:47.315448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:47.316408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:47.329016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.339867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.341213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.341573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.372664 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:47.384786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fc7c3ee1-ece1-4fa1-926e-5630bad41e2a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1275 microversion: 2.1 time: 0.131046 Nov 09 04:58:47.386368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 233/457] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:47 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:47.438289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:47.439368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:47.446996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952832b106844dea05a888f4266dd95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bab423d141e49b29b86b769cfa8d939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:47.455107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.455314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f7da66a-b235-4035-a26f-91681fac71f1 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 200 len: 1460 microversion: 2.1 time: 0.150994 Nov 09 04:58:47.455572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.455890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 225/458] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:47 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 1460 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:47.456440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.456876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.563127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:47.574406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-52457dc7-9b17-4c4c-bef3-aeb9a52f5da8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1277 microversion: 2.1 time: 0.144004 Nov 09 04:58:47.594899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 234/459] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:47 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:47.972634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:47.973229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:47.979388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.979904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:47.980926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:47.981355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.132277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-c748f1bb-d4be-42c8-aa2b-debf08c86788 req-675d2625-0f33-450e-afe6-d724e6401b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8148a52-7fc3-4958-ac13-5a60c71c69ea", "name": "network-vif-deleted", "tag": "3a90fc76-326e-43cd-a452-eed132093ac5"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:48.134492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:48.134492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:58:48.143378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-c748f1bb-d4be-42c8-aa2b-debf08c86788 req-675d2625-0f33-450e-afe6-d724e6401b17 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.144081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-c748f1bb-d4be-42c8-aa2b-debf08c86788 req-675d2625-0f33-450e-afe6-d724e6401b17 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.158715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-c748f1bb-d4be-42c8-aa2b-debf08c86788 req-675d2625-0f33-450e-afe6-d724e6401b17 service nova] Creating event network-vif-deleted:3a90fc76-326e-43cd-a452-eed132093ac5 for instance c8148a52-7fc3-4958-ac13-5a60c71c69ea on hv-cinder-81713 Nov 09 04:58:48.164490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-c748f1bb-d4be-42c8-aa2b-debf08c86788 req-675d2625-0f33-450e-afe6-d724e6401b17 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035873 Nov 09 04:58:48.165315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 235/460] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:58:48.263855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:48.264954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.271348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.272044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.273022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.273647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.314367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:48.326318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c7f04a15-ed84-42fa-9232-950b14d3ea34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1502 microversion: 2.1 time: 0.357241 Nov 09 04:58:48.328031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 226/461] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1502 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:48.333564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:48.335716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.346400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.347979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.348826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.349508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.379829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c92c3e3c-1c48-4f71-a3ce-9c8842bbe703 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.120648 Nov 09 04:58:48.381367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 236/462] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:48 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:48.392533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7dd77ac-504d-4a73-a570-07881e75cc94"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:48.399060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.413824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.416796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.418686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.419487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.452298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] HTTP exception thrown: Cannot 'attach_volume' instance 367541e4-c608-43b0-90da-677a42dc9b16 while it is in vm_state rescued Nov 09 04:58:48.452711 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Returning 409 to user: Cannot 'attach_volume' instance 367541e4-c608-43b0-90da-677a42dc9b16 while it is in vm_state rescued {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:58:48.453549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d1f95239-2aeb-4c8e-8b58-1b62b1be4da0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070853 Nov 09 04:58:48.454273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 237/463] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:58:48 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 09 04:58:48.462298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:48.462905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.471667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.472122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.473554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.473554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.503340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8dff24a4-25ad-45a5-8ae7-2bc98fc0f284 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 0.173887 Nov 09 04:58:48.504004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 227/464] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:48 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:48.509202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:48.510015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.519845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.520363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.521216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.521719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.610543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3b8590b9-639d-4351-b90f-fb746a563f1a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action" status: 202 len: 0 microversion: 2.1 time: 0.104842 Nov 09 04:58:48.612941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 228/465] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:48 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:48.621305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:48.622517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] [instance: c8148a52-7fc3-4958-ac13-5a60c71c69ea] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.629543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.630261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.631262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.632945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.657207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] HTTP exception thrown: Instance c8148a52-7fc3-4958-ac13-5a60c71c69ea could not be found. Nov 09 04:58:48.658046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] Returning 404 to user: Instance c8148a52-7fc3-4958-ac13-5a60c71c69ea could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:58:48.664328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9d601db7-5530-40fe-aa16-e8ebe5fe0873 tempest-VolumesActionsTest-1789963631 tempest-VolumesActionsTest-1789963631-project] 10.222.0.41 "GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea" status: 404 len: 111 microversion: 2.1 time: 0.049513 Nov 09 04:58:48.665903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 229/466] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:48 2021] GET /compute/v2.1/servers/c8148a52-7fc3-4958-ac13-5a60c71c69ea => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 04:58:48.672895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:48.673511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.681734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.682178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.683373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.683885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.728843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:48.736281 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-83641403-77e8-4028-ae40-f5d9f55a2394 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.279573 Nov 09 04:58:48.736847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 238/467] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:48 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:48.768658 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:48.772749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:48.786557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.788674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.793790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:48.793790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:48.999690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:49.008733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d04410a2-d40e-477b-b6a6-4135ec768c87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.341141 Nov 09 04:58:49.013362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 230/468] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:49.020087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-362f8000-fdc6-4070-88bf-d58801844c3c req-982c74db-8a17-4727-933f-903a1db95cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3376205e-2dfb-4a11-bf1d-f56697031624", "tag": "b4486560-446e-4f4a-b732-29ca12b603ba"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:49.021747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:49.021747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:58:49.050876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-362f8000-fdc6-4070-88bf-d58801844c3c req-982c74db-8a17-4727-933f-903a1db95cb9 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.051694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-362f8000-fdc6-4070-88bf-d58801844c3c req-982c74db-8a17-4727-933f-903a1db95cb9 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.066047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-362f8000-fdc6-4070-88bf-d58801844c3c req-982c74db-8a17-4727-933f-903a1db95cb9 service nova] Creating event network-changed:b4486560-446e-4f4a-b732-29ca12b603ba for instance 3376205e-2dfb-4a11-bf1d-f56697031624 on hv-cinder-81713 Nov 09 04:58:49.072426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-362f8000-fdc6-4070-88bf-d58801844c3c req-982c74db-8a17-4727-933f-903a1db95cb9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057427 Nov 09 04:58:49.073480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 231/469] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:49.257335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:49.270672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1b7f2845-1b7f-4920-8bd3-7f262ed98743 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1510 microversion: 2.1 time: 0.529843 Nov 09 04:58:49.273652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 239/470] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:49.392845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:49.394566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:49.401302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.402062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.403511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.404105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.516632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:49.517619 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:49.527318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.527898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.529238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.529921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.594955 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b0220f35-4501-4823-91e5-5d60d8e9b23a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.205754 Nov 09 04:58:49.598857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 232/471] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:49 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:49.754719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:49.755416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:49.762239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.762952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.764398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:49.764828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:49.978526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:49.986036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ed0b944f-02f1-4603-b427-704294dfe01f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.235807 Nov 09 04:58:49.986606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 233/472] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:49 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:50.031585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:50.032393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:50.039410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.040075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.040859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.041409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.177078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:50.184405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4f167488-8b98-4617-bc0e-860f9321c264 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.157939 Nov 09 04:58:50.184988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 234/473] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:50 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:50.189236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-40e37ed5-fbe4-423c-9f6a-96b8392eaa15 req-2654fd66-1b59-4a2b-91bc-b961d3891ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa39714e-2b95-4e72-83de-9acc03f82eb2", "tag": "1052eb61-9d88-48ed-ae53-fc737786ab8f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:50.190694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:58:50.190694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:58:50.197050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-40e37ed5-fbe4-423c-9f6a-96b8392eaa15 req-2654fd66-1b59-4a2b-91bc-b961d3891ab0 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.197479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-40e37ed5-fbe4-423c-9f6a-96b8392eaa15 req-2654fd66-1b59-4a2b-91bc-b961d3891ab0 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.208009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-40e37ed5-fbe4-423c-9f6a-96b8392eaa15 req-2654fd66-1b59-4a2b-91bc-b961d3891ab0 service nova] Creating event network-changed:1052eb61-9d88-48ed-ae53-fc737786ab8f for instance fa39714e-2b95-4e72-83de-9acc03f82eb2 on hv-cinder-81713 Nov 09 04:58:50.212501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-40e37ed5-fbe4-423c-9f6a-96b8392eaa15 req-2654fd66-1b59-4a2b-91bc-b961d3891ab0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026414 Nov 09 04:58:50.213047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 235/474] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:58:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:58:50.288017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:50.288718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:50.294746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.295183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.295967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.296387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.509415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-300224da-36c1-4d6d-bf0e-41a68fdf0ae1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 0.998045 Nov 09 04:58:50.513145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 240/475] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:49 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 04:58:50.610795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:50.612014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:50.618933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.619491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.620898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:50.621436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:50.643965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:50.653334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2b410484-4a98-4470-8248-20062a7b5cc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1510 microversion: 2.1 time: 0.369020 Nov 09 04:58:50.654048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 236/476] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1510 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:51.003103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:51.003655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:51.009946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:51.010382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:51.011805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:51.012231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:51.138216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:51.145450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4fa42cf6-29ec-471f-abe5-591b588bd48a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.146044 Nov 09 04:58:51.146090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 237/477] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:50 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:51.200881 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:51.201478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:51.207232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:51.207708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:51.208476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:51.208904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:51.337355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:51.344621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2f4ea069-e3fc-4008-a263-81d4f83d11b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.147885 Nov 09 04:58:51.345188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 238/478] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:51.520754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:51.521724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:51.528211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:51.528645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:51.529393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:51.529818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.514005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4b3f6aec-8726-4b16-98cc-8466c9cb2cac tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 3.907053 Nov 09 04:58:54.514660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 241/479] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:50 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 3909 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:54.519720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:54.520303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:54.528359 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:54.528811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.529595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:54.530032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.564503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d55fd282-d0f4-4b01-82e9-0b627e8b70ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 3.047369 Nov 09 04:58:54.568031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 239/480] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:51 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 3049 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 04:58:54.571361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:54.572182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:54.580281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:54.581107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.582152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:54.582881 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.666770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:54.674460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5117f70d-53c2-4ef2-84af-bf7b04ad49fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1510 microversion: 2.1 time: 0.158521 Nov 09 04:58:54.675377 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 242/481] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:54.679702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:54.680433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:54.686213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:54.686654 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.687424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:54.687874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:54.727576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:54.736056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eef9b777-3a35-4c24-840b-953906bea86d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.169491 Nov 09 04:58:54.736634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 240/482] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:54 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:54.826269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:54.833446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c1ff8ae9-d9ec-4864-88df-9a816718fa7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.157071 Nov 09 04:58:54.834024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 243/483] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:54 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:55.526104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:55.527590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:55.534058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.534493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.535245 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.535696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.575405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:55.576351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:55.582548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.582995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.583803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.584239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.964967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-66ca7848-c094-408f-8053-171cee56b730 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 0.392326 Nov 09 04:58:55.965608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 244/484] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:55 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:55.970398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:55.971096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:55.977787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.978230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.979070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.979431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.983637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-72bab27d-8761-49c5-9296-a5ad0620bb96 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.461067 Nov 09 04:58:55.987963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 241/485] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:55 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:55.989185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:55.989848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:55.996684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.997118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:55.997871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:55.998302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:56.111990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:56.119686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b5efaec6-b8c2-47d5-a257-0cae05d335c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1510 microversion: 2.1 time: 0.152949 Nov 09 04:58:56.120261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 245/486] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:56.124930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:56.125657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:56.131467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:56.131947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:56.132727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:56.133168 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:56.135792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:56.143868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d45dbf1e-900e-4ce9-9184-ffc738a8730c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.158309 Nov 09 04:58:56.144435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 242/487] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:55 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:56.266416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:56.273589 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f60170d0-6b84-4072-94f4-ce235a6d0a27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.152385 Nov 09 04:58:56.274159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 246/488] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:56.975698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:56.976430 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:56.983202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:56.983919 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:56.985282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:56.985878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:56.998163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:56.999308 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:57.011736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.012803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.013980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.014659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.138792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-813e17a4-75c2-4095-83bc-1c2071268bcc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 14 microversion: 2.1 time: 0.166796 Nov 09 04:58:57.139729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 243/489] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:56 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:58:57.144673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:57.145358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:57.157165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.157633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.158426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.158860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.162804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85facdb6-07c0-4da7-98c1-14befc85cae4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.170393 Nov 09 04:58:57.167586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 247/490] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:56 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:58:57.173064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:57.174031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:57.181054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.181706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.182639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.183996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.335126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:57.344200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aa0c5478-1672-4386-94ef-fb32b0351e7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1510 microversion: 2.1 time: 0.203122 Nov 09 04:58:57.349239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 244/491] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:57.349814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:57.350673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:57.356896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.357646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.358649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:57.359313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:57.378681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:57.387127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f1e6b769-d0f0-4ba9-b4d0-ba6504d18794 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.218146 Nov 09 04:58:57.404215 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 248/492] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:57 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:57.521090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-875092354", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:57.534016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:57.544627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4f22828a-3080-4dd9-aaee-bcd5cc09e41d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.198299 Nov 09 04:58:57.545603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 245/493] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:57 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:57.612345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] validate_networks() for None {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:58:58.150557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:58.151634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:58.161297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.162194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.163503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.164353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.258022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:58:58.258661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:58:58.258982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:58:58.259398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:58:58.259861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:58:58.274092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.274655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.275602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.276430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.291538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e5806330-0b92-4146-8134-7cfd5af89ed2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 1586 microversion: 2.1 time: 0.145062 Nov 09 04:58:58.292989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 246/494] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:58 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 1586 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:58:58.298703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:58.303096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:58.305207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Getting quotas for project 777d920b381b4d6ebddb042851d48a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:58:58.311534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Getting quotas for user 8e40320037334f188c1696df06da0bfc and project 777d920b381b4d6ebddb042851d48a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:58:58.317284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.317916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.318754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.319185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.324892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:58:58.328726 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:58:58.384522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c5d1f69-2e20-4da2-9187-477382ebd8ca tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867329 Nov 09 04:58:58.391832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 249/495] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:58:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:58:58.397349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:58.398282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:58.414781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.414781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.415674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.416725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.568179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:58.569042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-107e3279-816f-4cbe-8ebc-567102bc7110 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.269009 Nov 09 04:58:58.570014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 247/496] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:58 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:58.578207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-770049f3-667d-4d9e-8a51-06ec0c43ec7d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:58.579418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-770049f3-667d-4d9e-8a51-06ec0c43ec7d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:58.580021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-121726c2-0842-4785-a20e-258dec7c5745 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1510 microversion: 2.1 time: 0.187038 Nov 09 04:58:58.580605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 250/497] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:58.590257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:58.594083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:58.600247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.600660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.601442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.605256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.654710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-770049f3-667d-4d9e-8a51-06ec0c43ec7d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:58.663150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-770049f3-667d-4d9e-8a51-06ec0c43ec7d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1214 microversion: 2.1 time: 0.091408 Nov 09 04:58:58.664395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 248/498] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:58 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:58.675178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:58.676012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:58.683371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.684166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.685165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:58.685768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:58.870405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:58.878798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f66e8251-96b0-42ea-8177-7f922c6ef8ca tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.295538 Nov 09 04:58:58.894819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 251/499] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:58 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:58.908337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:58.918692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c971cbf9-c69b-47d2-834e-0f2085a8a4b0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.252431 Nov 09 04:58:58.922822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 249/500] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:58 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:59.319144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:59.319144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:59.360556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.361005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.361810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.362250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.534856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-013e4ec1-f6c8-4707-9ab9-2ad8ae9bbe9e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 10414 microversion: 2.1 time: 0.224634 Nov 09 04:58:59.536731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 252/501] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:58:59 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 10414 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:58:59.582486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:58:59.583392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:59.589982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.590425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.591382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.591985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.598496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:59.599381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:59.606647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.607227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.608382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.608912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.719390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c1f916bb-86f2-4bd7-acef-358d76208f39 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28133 microversion: 2.20 time: 0.140045 Nov 09 04:58:59.727697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 250/502] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:58:59 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28133 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:58:59.730089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:59.733107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:59.750914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.753491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.754322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.754766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.770104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:59.780929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d82b7a54-12be-4671-87f1-fd704ae2f320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1516 microversion: 2.1 time: 0.186477 Nov 09 04:58:59.793354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 253/503] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:59.841763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:58:59.866153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-31d96fe8-6fb7-4f9c-af00-f1460e2e9ec6 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1266 microversion: 2.1 time: 0.144433 Nov 09 04:58:59.881534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 251/504] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:59 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:58:59.900390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:59.901585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:59.909757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.915938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.919903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.920365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.939376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:58:59.940028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:58:59.960158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.960612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:58:59.961421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:58:59.961848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:00.202836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:00.213651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-be95fcba-3b76-427d-9a46-071f91e520a3 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.317159 Nov 09 04:59:00.215088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 254/505] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:59 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:00.419602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:00.428037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cebc0f16-c458-45c0-a85c-2118f71131b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.492953 Nov 09 04:59:00.435084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 252/506] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:58:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:00.547409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:00.549034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:00.564590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:00.565309 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:00.567982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:00.568597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:00.709663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-80617aab-39ea-4f45-9519-7e18755eb611 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 16319 microversion: 2.1 time: 0.166320 Nov 09 04:59:00.711019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 255/507] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:00 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 16319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:00.732173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:00.733098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:00.739149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:00.739449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:00.740835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:00.744686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:00.890948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:00.891677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:00.906075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2b311154-7716-4517-8d09-7f4103e62153 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28325 microversion: 2.20 time: 0.176898 Nov 09 04:59:00.911259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 253/508] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:00 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28325 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:00.923834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:00.927343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:00.928624 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:00.929272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.047374 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:01.060171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0781e433-7ee2-4a5d-a5cc-2d7002d20a4d tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1272 microversion: 2.1 time: 0.173885 Nov 09 04:59:01.062120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 256/509] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:00 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:01.232867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:01.234263 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:01.241909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.242491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.243388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.243943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.451597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:01.452422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:01.465548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.467541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.471032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.475057 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.559256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:01.568180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-abfb93f4-3ab4-4162-9b5a-b9798f4a1a6d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.340606 Nov 09 04:59:01.572410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 254/510] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:01 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:01.723471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:01.725110 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:01.738315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.740297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.744208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.747101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.810803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:01.825690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7d3f8196-f211-4420-ac13-6e6d54e7a542 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.378799 Nov 09 04:59:01.826917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 257/511] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:01.867165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-56f4921b-d095-4469-a790-f6f139bb060f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 17861 microversion: 2.1 time: 0.148752 Nov 09 04:59:01.873279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 255/512] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:01 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 17861 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:01.918696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:01.920347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:01.938201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.939012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:01.940066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:01.940749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.079008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:02.080826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:02.084422 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-af176a96-f4c4-4428-b631-edee813d883c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28422 microversion: 2.20 time: 0.169863 Nov 09 04:59:02.085075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 258/513] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:01 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28422 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:02.090254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.093634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.095713 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.095713 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.352082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:02.367712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1741e3ac-a092-4587-97f4-999b7b1dfe4c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.292919 Nov 09 04:59:02.373103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 256/514] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:02 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:02.459253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:02.460270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:02.476101 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.476748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.481824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.482303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.590423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:02.591034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:02.600985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.601618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.602427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.602858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.703225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:02.713687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9416f492-3268-499e-82d8-0b388a0ed825 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1516 microversion: 2.1 time: 0.259042 Nov 09 04:59:02.715610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 259/515] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:02.736816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85a2f6be-f1c2-4526-820d-29793c6c4e3e"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:02.737833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:02.753774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.754789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.755805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:02.756364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:02.949553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:02.962369 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5302ed29-c19b-47c1-9c61-e90af9f3ca3d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.375660 Nov 09 04:59:02.970506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 257/516] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:02 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:02.979068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-8a83a113-6c23-4151-9eda-714234fb5ee5 req-de9359d7-cedc-4141-9f35-ae0d9d418470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a380611-e828-486c-b04d-218365157ced", "tag": "b4e3a44e-be05-454c-92ab-707f4094730f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:02.983021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:02.983021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:59:03.037763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-8a83a113-6c23-4151-9eda-714234fb5ee5 req-de9359d7-cedc-4141-9f35-ae0d9d418470 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.041398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-8a83a113-6c23-4151-9eda-714234fb5ee5 req-de9359d7-cedc-4141-9f35-ae0d9d418470 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.085066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-8a83a113-6c23-4151-9eda-714234fb5ee5 req-de9359d7-cedc-4141-9f35-ae0d9d418470 service nova] Creating event network-changed:b4e3a44e-be05-454c-92ab-707f4094730f for instance 7a380611-e828-486c-b04d-218365157ced on hv-cinder-81713 Nov 09 04:59:03.098968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-8a83a113-6c23-4151-9eda-714234fb5ee5 req-de9359d7-cedc-4141-9f35-ae0d9d418470 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126843 Nov 09 04:59:03.103066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 258/517] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:03.119729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:03.122349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:03.149498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.150458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.151736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.152385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.393994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1657dea5-9d80-48c7-aece-227711cf8061 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666275 Nov 09 04:59:03.394979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 260/518] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:59:02 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:03.401817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:03.403304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:03.413265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.414384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.418392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.419370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.438265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:03.445610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-26d3c3d3-cbda-4b33-ad28-0ddcc7f42e61 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.337862 Nov 09 04:59:03.457486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 259/519] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:03.464444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:03.465344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:03.471537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.472345 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.473349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.474254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.616948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ac7e951e-5d25-4b94-bf3e-aa6a99e59683 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 20991 microversion: 2.1 time: 0.220196 Nov 09 04:59:03.617990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 261/520] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:03 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 20991 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:03.623430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:03.624411 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:03.632563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.633014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.633827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:03.634447 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:03.679095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-77d54dc5-9dbd-498c-8d5d-75a4a1b3e27e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28422 microversion: 2.20 time: 0.219224 Nov 09 04:59:03.679778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 260/521] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:03 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28422 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:03.815293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:03.826083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-179d4478-eaa7-4f8e-a90a-b5006a7b21ab tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.206123 Nov 09 04:59:03.827612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 262/522] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:03 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:03.995071 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-a54ba924-b046-42a4-9503-3cce4300fd76 req-dc97a391-e3a1-43fe-bad1-3e9ccf404481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3376205e-2dfb-4a11-bf1d-f56697031624", "name": "network-vif-plugged", "status": "completed", "tag": "b4486560-446e-4f4a-b732-29ca12b603ba"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:03.995933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:03.998953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:04.001676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:04.001676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:59:04.021345 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.022620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.025597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.026989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-a54ba924-b046-42a4-9503-3cce4300fd76 req-dc97a391-e3a1-43fe-bad1-3e9ccf404481 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.027743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-a54ba924-b046-42a4-9503-3cce4300fd76 req-dc97a391-e3a1-43fe-bad1-3e9ccf404481 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.027967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.051887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-a54ba924-b046-42a4-9503-3cce4300fd76 req-dc97a391-e3a1-43fe-bad1-3e9ccf404481 service nova] Creating event network-vif-plugged:b4486560-446e-4f4a-b732-29ca12b603ba for instance 3376205e-2dfb-4a11-bf1d-f56697031624 on hv-cinder-81713 Nov 09 04:59:04.063174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-a54ba924-b046-42a4-9503-3cce4300fd76 req-dc97a391-e3a1-43fe-bad1-3e9ccf404481 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079015 Nov 09 04:59:04.071976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 263/523] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:04.239061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:04.252708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e733e518-d4f9-4db4-901e-dc594f87a82b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.264050 Nov 09 04:59:04.264826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 261/524] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:03 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:04.464146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:04.464939 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:04.475065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.476275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.477991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.478511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.629154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:04.630401 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:04.637386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.637959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.639189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.639856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.660758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:04.668576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d95fe2cd-b36c-41cd-b136-788801057769 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.208716 Nov 09 04:59:04.672193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 264/525] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:04 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:04.690492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:04.691524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:04.697645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.698147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:04.699446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:04.699916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.309762 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7152336b-fb5c-4808-8365-e45d19a698ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.622954 Nov 09 04:59:05.311428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 265/526] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:04 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:05.315491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:05.316254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:05.323985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:05.324460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.325243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:05.325675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.428500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e45d7d2c-0b6b-41f4-b5ab-11f18b60a22b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 23229 microversion: 2.1 time: 0.802366 Nov 09 04:59:05.438844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 262/527] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:04 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 23229 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:05.452407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:05.453837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:05.465938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:05.466649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.467609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:05.468216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.480885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:05.490701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ede7ece5-5e03-435c-b7dd-06d6901c291f tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.178814 Nov 09 04:59:05.500563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 266/528] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:05 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:05.674685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:05.692768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:05.693003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-93b0f7f0-3f5e-4244-ab45-75d8b9c43d46 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.249978 Nov 09 04:59:05.693500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 263/529] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:05 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:05.693970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:05.700984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:05.701431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.703328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:05.703869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:05.852461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:05.861518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ac7f6d2c-31ea-4283-960d-1fe5dd2d5445 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.174575 Nov 09 04:59:05.862319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 267/530] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:05 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:06.094326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-f2bf4646-67a2-4dbe-968f-33ad93768112 req-d074dce5-0923-48aa-9f5d-a6139a0c5dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa39714e-2b95-4e72-83de-9acc03f82eb2", "name": "network-vif-plugged", "status": "completed", "tag": "1052eb61-9d88-48ed-ae53-fc737786ab8f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:06.097320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:06.097320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:59:06.113371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-f2bf4646-67a2-4dbe-968f-33ad93768112 req-d074dce5-0923-48aa-9f5d-a6139a0c5dad service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.114170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-f2bf4646-67a2-4dbe-968f-33ad93768112 req-d074dce5-0923-48aa-9f5d-a6139a0c5dad service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.135743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-f2bf4646-67a2-4dbe-968f-33ad93768112 req-d074dce5-0923-48aa-9f5d-a6139a0c5dad service nova] Creating event network-vif-plugged:1052eb61-9d88-48ed-ae53-fc737786ab8f for instance fa39714e-2b95-4e72-83de-9acc03f82eb2 on hv-cinder-81713 Nov 09 04:59:06.143435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-f2bf4646-67a2-4dbe-968f-33ad93768112 req-d074dce5-0923-48aa-9f5d-a6139a0c5dad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054437 Nov 09 04:59:06.144815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 264/531] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:06.330803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:06.331972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:06.341039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.342647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.342647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.342977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.461895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:06.468170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:06.488720 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.489162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.489946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.490371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.519727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c46b6b68-aa44-42f1-8586-a47b17359982 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.197484 Nov 09 04:59:06.520390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 268/532] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:06 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:06.525111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:06.525790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:06.533194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.533637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.534417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.534849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.714112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:06.721647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3e00afcd-0592-4f4f-9587-12871ac0c4f1 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.200140 Nov 09 04:59:06.722342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 269/533] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:06 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:06.727191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:06.727837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:06.735388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.736053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.737345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.737899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.890934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:06.898774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b390d576-3d46-4fab-bfdf-baa6e6b780e2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1317 microversion: 2.1 time: 0.175417 Nov 09 04:59:06.899667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 270/534] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:06 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:06.908923 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:06.909788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:06.919149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.920015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:06.920924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:06.921455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:07.076492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:07.084854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0916ad80-ef38-4f23-9df8-27b044ae04e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.179832 Nov 09 04:59:07.086000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 271/535] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:07.271269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-20ce01df-9289-44be-8292-fcd258dc5eb5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 25045 microversion: 2.1 time: 0.828664 Nov 09 04:59:07.276178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 265/536] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:06 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 25045 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:07.543392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:07.545886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:07.553878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:07.554647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:07.556365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:07.557904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:07.738733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:07.740107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:07.750286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:07.750734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:07.753946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:07.755539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:07.783781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3498a1b0-f5ef-489b-8985-b5b1cab9d6be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.254885 Nov 09 04:59:07.785032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 272/537] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:07 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:07.908622 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:07.917966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:07.918718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:07.919332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6d3f3911-b150-4fcb-b33c-4ae7aee83fce tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.183410 Nov 09 04:59:07.924207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 266/538] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:07 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:07.935244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:07.935745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:07.936553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:07.937042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.091659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:08.099093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8420f8bb-8937-410b-b374-d0d3fedd5d93 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1508 microversion: 2.1 time: 0.186170 Nov 09 04:59:08.099771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 273/539] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:07 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:08.103092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:08.103725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:08.113711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.114203 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.115247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.115775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.285560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:08.286549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:08.300531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.300983 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.304132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:08.306406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.306942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.315518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b9126fca-0753-4bbe-84ef-60eb4aa36613 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.216103 Nov 09 04:59:08.327140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 267/540] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:08 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:08.480440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f9a182b5-4cfb-48f0-a7a7-f50ea1d60e92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 26045 microversion: 2.1 time: 0.198876 Nov 09 04:59:08.481141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 274/541] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:08 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 26045 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:08.799079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:08.801359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:08.820255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.826738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.828274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.829130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.942982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:08.944608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:08.952084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.952640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:08.953512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:08.954018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:09.095448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3dd90573-774f-4379-8c23-7abeedc19bef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.301520 Nov 09 04:59:09.096900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 268/542] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:08 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:09.100913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:09.108597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-789038f6-4d45-4346-b955-461a1700dd88 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.171898 Nov 09 04:59:09.109972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 275/543] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:08 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:09.333327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:09.334304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:09.341358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:09.341808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:09.342768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:09.343205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:09.503738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:09.503738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:09.503738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:09.503738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:09.504932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:09.506548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:09.574235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:09.608869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-34664d9d-9014-4cfc-b35a-37faf3eb5495 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1319 microversion: 2.1 time: 0.279601 Nov 09 04:59:09.609754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 269/544] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:09.705209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-454e0364-9292-4fd1-ac5c-83b6eccd1712 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 26720 microversion: 2.1 time: 0.215845 Nov 09 04:59:09.706493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 276/545] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:09 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 26720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:10.111167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:10.113536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:10.126030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.126982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:10.127459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.128015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:10.129066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.129825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.135023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.136043 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.136839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.137282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.291756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:10.299333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a3ba907a-598a-4f64-86bd-3f1e77e1e78c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.176789 Nov 09 04:59:10.300360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 277/546] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:10 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:10.330025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b88feab7-2b0a-42f8-820f-0931c8d7fa57 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.225839 Nov 09 04:59:10.331431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 270/547] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:10 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:10.555151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88fdfebb-1e1a-44d7-a9c5-80bd49a49a27"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:10.556401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:10.563921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.564932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.565832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.566357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.628438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:10.629560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:10.650868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.652912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.654596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.656445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.843995 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:10.859104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bd1da16c-9560-4145-b5fb-71c50f6a602a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1507 microversion: 2.1 time: 0.235309 Nov 09 04:59:10.879876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 271/548] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:10 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:10.890581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:10.892004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:10.912994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.913661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.914761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:10.915357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:10.961933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4bd9021b-ecb8-4420-8da3-62f2eaf88f4a tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407957 Nov 09 04:59:10.974045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 278/549] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:59:10 2021] POST /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:11.176448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1241668f-db72-4b5a-a3cb-726ddb5963fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 27406 microversion: 2.1 time: 0.293916 Nov 09 04:59:11.177452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 272/550] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:10 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 27406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:11.320100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:11.321602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:11.333935 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:11.334813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:11.335919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:11.336584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:11.343515 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:11.344764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:11.361807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:11.368205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:11.369760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:11.370378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:11.592932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37e4c460-9bf2-4cdf-acd1-4aa21a9d39ef tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.253986 Nov 09 04:59:11.597818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 273/551] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:11 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:11.646198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:11.654601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-088264cb-ee47-4f70-9a9a-67bd9b830bc3 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.339903 Nov 09 04:59:11.655835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 279/552] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:11 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:12.176192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:12.177983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:12.189040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:12.189222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.189884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.190384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:12.190857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.191310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.199652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.200089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.200878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.201313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.225057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lazy-loading 'flavor' on Instance uuid 367541e4-c608-43b0-90da-677a42dc9b16 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:59:12.345595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9b6a0655-c932-4c77-a521-42ce76956e5b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 27692 microversion: 2.1 time: 0.160345 Nov 09 04:59:12.346528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 280/553] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:12 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 27692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:12.349293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d221c25f-540d-40a6-bbd0-b3e82d4d4807 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action" status: 200 len: 32 microversion: 2.1 time: 0.177455 Nov 09 04:59:12.350301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 274/554] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:12 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:59:12.361629 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:12.362880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:12.371784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.372927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.374333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.375028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.550774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:12.559575 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e105a101-b1d6-4e73-a55c-0d40623f12db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.203329 Nov 09 04:59:12.560357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 281/555] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:12.607536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:12.608633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:12.627052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.627510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.628337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.628791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.672220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:12.673121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:12.679511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.679987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.680790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:12.681432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:12.765841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-db979c84-dd31-4bc5-b90a-ffbc99422369 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.163801 Nov 09 04:59:12.766414 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 275/556] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:12 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:12.845408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:12.853585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8c5ebda7-ce56-4feb-ae68-51579f16c0fe tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.185051 Nov 09 04:59:12.855205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 282/557] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:12 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:13.358253 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:13.359396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:13.367589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.368075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.368903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.369350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.489316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-77c0044e-8934-47e7-bc02-cbecf5c022ec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 27884 microversion: 2.1 time: 0.135249 Nov 09 04:59:13.493025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 276/558] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:13 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 27884 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:13.578105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:13.579252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:13.586581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.587261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.588219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.588798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.779652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:13.785584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:13.786808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:13.796715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f1d5bd49-518f-4441-b7a9-8b8f1c827a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.222743 Nov 09 04:59:13.797301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 283/559] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:13.803024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.803605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.804436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.804959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.873205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:13.874351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:13.881733 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.882298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.883127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:13.883569 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:13.943188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a464f365-32ad-4bc5-8bbe-048ca745cc68 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.168538 Nov 09 04:59:13.948948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 277/560] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:13 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:14.052572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:14.062552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e43e7b84-205d-42b1-aa83-158ace2e3c92 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.194684 Nov 09 04:59:14.065027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-e63e11a6-4629-4147-9692-c461d6f09253 req-4b2d83f6-3a45-4305-a981-baa2b4599619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a380611-e828-486c-b04d-218365157ced", "name": "network-vif-plugged", "status": "completed", "tag": "b4e3a44e-be05-454c-92ab-707f4094730f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:14.067133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:14.067133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:59:14.067611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 284/561] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:13 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:14.080664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-e63e11a6-4629-4147-9692-c461d6f09253 req-4b2d83f6-3a45-4305-a981-baa2b4599619 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.081769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-e63e11a6-4629-4147-9692-c461d6f09253 req-4b2d83f6-3a45-4305-a981-baa2b4599619 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:14.095684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-e63e11a6-4629-4147-9692-c461d6f09253 req-4b2d83f6-3a45-4305-a981-baa2b4599619 service nova] Creating event network-vif-plugged:b4e3a44e-be05-454c-92ab-707f4094730f for instance 7a380611-e828-486c-b04d-218365157ced on hv-cinder-81713 Nov 09 04:59:14.103534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-e63e11a6-4629-4147-9692-c461d6f09253 req-4b2d83f6-3a45-4305-a981-baa2b4599619 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043518 Nov 09 04:59:14.104226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 278/562] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:14.501982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:14.503110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:14.510047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.511073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:14.511976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.512414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:14.815557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:14.816372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:14.823384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.823823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:14.824668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.825126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:14.975800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:14.977018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2aa42cb2-54fa-4cb7-9ec8-1bcc7ce4965d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.166027 Nov 09 04:59:14.977650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 279/563] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:14.982862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:14.983865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:14.990673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.991166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:14.991991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:14.992427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:15.441587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed52ece7-745f-4cb9-8307-4c7adfffa0a5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28063 microversion: 2.1 time: 0.943126 Nov 09 04:59:15.442279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 285/564] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:14 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28063 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:15.447060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:15.448301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:15.454932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:15.455402 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:15.456184 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:15.456701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:15.481687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e5ed2598-8923-4bd9-ae02-0604260b406d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.502597 Nov 09 04:59:15.482434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 280/565] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:14 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:15.589828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:15.597455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-666f8ed2-8d87-42bd-ba06-930182086848 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.154082 Nov 09 04:59:15.598011 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 286/566] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:15 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:15.995332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:15.996397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:16.003917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.004540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.005322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.005748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.157653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:16.165650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1d3401d8-3206-4de9-9026-80d593b06445 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.175059 Nov 09 04:59:16.166215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 281/567] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:16.453634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:16.454579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:16.462175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.464423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.465226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.465661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.493257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:16.494265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:16.500838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.501278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.502050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.502474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.633109 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9505f5ce-8dde-4dcb-8744-749e272cbf07 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.143710 Nov 09 04:59:16.633883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 282/568] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:16 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:16.642992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:16.643726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:16.651404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.651867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.652734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:16.653218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:16.668190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-aac96745-d2ea-4598-a428-dab8bbdb1818 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.218429 Nov 09 04:59:16.669222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 287/569] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:16 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:16.790098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:16.797352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-743a7525-0c9a-4c15-82a7-8327c0454d84 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1314 microversion: 2.1 time: 0.158395 Nov 09 04:59:16.797917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 283/570] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:16 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:17.184884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:17.185592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:17.195312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.196026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.197231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.197903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.346495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:17.354749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-32d1b58e-c5db-458d-b8ef-4116ea08a63f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.174602 Nov 09 04:59:17.355317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 288/571] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:17.646423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:17.647335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:17.654475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.655180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.655965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.656388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.684238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:17.685171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:17.692496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.692864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.693647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.694132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.841632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6ca033cd-20c9-4882-8dc8-f9d82094ebce tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.199124 Nov 09 04:59:17.842966 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 284/572] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:17 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:17.849050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:17.850008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:17.857730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.858170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.859126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:17.859557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:17.891227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ce914315-4647-46a7-94ce-aceaa9b53362 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.210606 Nov 09 04:59:17.894670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 289/573] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:17 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:17.999103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:18.006389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fe3c7bd5-4758-47a4-9f1f-e20854c114b8 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1464 microversion: 2.1 time: 0.161855 Nov 09 04:59:18.007019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 285/574] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:17 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:18.044742 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:18.045326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:18.052413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.052887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.053662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.054097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.079427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 04:59:18.154351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3d656f72-6ea7-498e-b8a6-fdd0a8489a7e tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 204 len: 0 microversion: 2.1 time: 0.113225 Nov 09 04:59:18.155145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 290/575] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 04:59:18 2021] DELETE /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 04:59:18.164008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:18.164716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:18.171899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.172434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.173458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.174019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.317625 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:18.325516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f1ef8d39-022c-442b-9847-19019221cf26 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1470 microversion: 2.1 time: 0.166044 Nov 09 04:59:18.326084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 286/576] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:18 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:18.372836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:18.373662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:18.379936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.380387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.381165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.381596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.549737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:18.568560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f21a3577-67fe-4803-bc5a-d3fc21fa2190 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.199821 Nov 09 04:59:18.569405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 291/577] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:18.854940 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:18.855885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:18.862051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.862491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.863253 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.863699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.904000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:18.905182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:18.911606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.912083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:18.912868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:18.913301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.033710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-209f4d79-093c-428f-a373-822a877d8f83 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.182962 Nov 09 04:59:19.035585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 287/578] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:18 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:19.082697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9dff0c1f-4d08-4269-8961-7384b5086b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.182947 Nov 09 04:59:19.084627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 292/579] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:18 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:19.342687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:19.343489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:19.350738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.351254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.352202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.352607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.501390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:19.510230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-71c0b4e4-8402-4675-b6b7-ecfbdbebedd5 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1470 microversion: 2.1 time: 0.171253 Nov 09 04:59:19.511697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 288/580] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:19 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:19.586860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:19.587987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:19.596323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.596996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.598064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.598649 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.671666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88fdfebb-1e1a-44d7-a9c5-80bd49a49a27"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:19.672798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:19.695004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.695461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.698891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.700752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.770641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:19.781093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7814b425-bcf8-4456-b355-5d45ef46b4cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.198265 Nov 09 04:59:19.781674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 293/581] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:19.806886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] HTTP exception thrown: Invalid volume: volume 88fdfebb-1e1a-44d7-a9c5-80bd49a49a27 is already attached to instances: 3376205e-2dfb-4a11-bf1d-f56697031624 Nov 09 04:59:19.808016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Returning 400 to user: Invalid volume: volume 88fdfebb-1e1a-44d7-a9c5-80bd49a49a27 is already attached to instances: 3376205e-2dfb-4a11-bf1d-f56697031624 {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:59:19.809314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7df5efc8-1583-466d-b98b-f2eeaf579436 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142487 Nov 09 04:59:19.809899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 289/582] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:59:19 2021] POST /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 09 04:59:19.866991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:19.867483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:19.873829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.874277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.875051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:19.875482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:19.952582 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lazy-loading 'services' on Instance uuid 3376205e-2dfb-4a11-bf1d-f56697031624 {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:59:20.019254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e7eb086f-98d9-42e0-ad5b-445a90843a97 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments/88fdfebb-1e1a-44d7-a9c5-80bd49a49a27" status: 202 len: 0 microversion: 2.1 time: 0.155858 Nov 09 04:59:20.020152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 294/583] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 04:59:19 2021] DELETE /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments/88fdfebb-1e1a-44d7-a9c5-80bd49a49a27 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:20.028934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:20.030210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:20.037440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.037887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.038667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.039269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.053431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:20.054416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:20.061424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.061873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.062654 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.063250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.069247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8afecb20-2ea8-47b4-a54f-625b3f04962b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Nov 09 04:59:20.069810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 290/584] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:20 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:20.094432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:20.095344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:20.101081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.101524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.102280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.102713 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.235276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3fed8389-ec46-4202-bec4-3a4dbc8026c6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.144166 Nov 09 04:59:20.236091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 291/585] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:20 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:20.274749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ce32cfa4-31b2-45d9-8742-0c7d535fd24e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.225151 Nov 09 04:59:20.276610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 295/586] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:20 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:20.527390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:20.528109 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:20.535149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.535597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.536379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.536810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.670540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:20.677692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b2afa4dd-bb92-4d01-8c2b-32c1060bef58 tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1470 microversion: 2.1 time: 0.154294 Nov 09 04:59:20.678258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 292/587] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:20 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:20.798475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:20.799158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:20.805970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.806412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.807885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:20.808403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:20.943453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:20.951216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b070cb88-4154-4169-82f8-1ca1a5b3579e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.156670 Nov 09 04:59:20.951867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 296/588] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:21.081068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:21.082000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:21.088912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.089354 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.090116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.090541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.119123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7b96bea8-e0cf-4cb4-ad17-597409fdc424 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Nov 09 04:59:21.119671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 293/589] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:21 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:21.248111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:21.249158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:21.255375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.255925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.256801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.257298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.287532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:21.288730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:21.295044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.295481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.296266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.296688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.420944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f3b07aad-bb37-4fbd-89a1-d215f16dc547 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.176933 Nov 09 04:59:21.421609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 297/590] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:21 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:21.451696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0b8edbb9-78fb-425f-8fa4-a3ddb57176f6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.167853 Nov 09 04:59:21.452361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 294/591] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:21 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:21.695421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:21.696162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:21.708631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.709213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.710082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.711416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.749884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-ae2fa8e4-d198-4145-a1a1-c6eb6bf76e28 req-d7dbf40d-76b9-47c1-8264-bde4cd68e8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a380611-e828-486c-b04d-218365157ced", "name": "network-vif-deleted", "tag": "b4e3a44e-be05-454c-92ab-707f4094730f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:21.751460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:21.751460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 04:59:21.767334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-ae2fa8e4-d198-4145-a1a1-c6eb6bf76e28 req-d7dbf40d-76b9-47c1-8264-bde4cd68e8f5 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.767828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-ae2fa8e4-d198-4145-a1a1-c6eb6bf76e28 req-d7dbf40d-76b9-47c1-8264-bde4cd68e8f5 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.784540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-ae2fa8e4-d198-4145-a1a1-c6eb6bf76e28 req-d7dbf40d-76b9-47c1-8264-bde4cd68e8f5 service nova] Creating event network-vif-deleted:b4e3a44e-be05-454c-92ab-707f4094730f for instance 7a380611-e828-486c-b04d-218365157ced on hv-cinder-81713 Nov 09 04:59:21.791925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40320037334f188c1696df06da0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777d920b381b4d6ebddb042851d48a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:21.796678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-ae2fa8e4-d198-4145-a1a1-c6eb6bf76e28 req-d7dbf40d-76b9-47c1-8264-bde4cd68e8f5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051196 Nov 09 04:59:21.797614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 295/592] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:21.809959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-29440fde-f105-401f-b8d9-264a6f60592c tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 200 len: 1428 microversion: 2.1 time: 0.119092 Nov 09 04:59:21.821988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 298/593] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:21 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:21.969885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:21.970828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:21.978945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.979391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:21.980200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:21.980865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.122437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:22.130312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:22.130492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f8409532-88cb-42a6-bcc3-6ba690682a43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.166093 Nov 09 04:59:22.130981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 296/594] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:22.131228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:22.138282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.138728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.139513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.139990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.168278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b08ee362-e673-46fd-810b-a4c3f8b1f24d tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041831 Nov 09 04:59:22.168833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 299/595] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:22 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 04:59:22.315692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1602460445", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "networks": [{"uuid": "9dc74574-bcbe-4d7d-85c6-61611faf1df6"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:22.371406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] validate_networks() for [('9dc74574-bcbe-4d7d-85c6-61611faf1df6', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 04:59:22.432489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:22.434189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:22.442545 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.443547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.444950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.445806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.572082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3e445d79-3387-4302-9703-20f1399f63a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.143506 Nov 09 04:59:22.576076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 300/596] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:22 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:22.577718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:22.578693 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:22.585454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.585839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.586606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.587035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.694850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3b96a955-b05b-4591-a746-54c17531ea04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.120609 Nov 09 04:59:22.698696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 301/597] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:22 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:22.746853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 04:59:22.747264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 04:59:22.747773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 04:59:22.748175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 04:59:22.748570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 04:59:22.757053 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.757487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.758272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.758692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.774188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 04:59:22.778530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Getting quotas for user 2dc41f90272e4a549aad1634f08342a6 and project 3e9bea92048e49debbf053fea8eb2b9f. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 04:59:22.789077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 04:59:22.791896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 04:59:22.828471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:22.829131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] [instance: 7a380611-e828-486c-b04d-218365157ced] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:22.836144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.836523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.837302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:22.837730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:22.837832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1408df21-523c-406d-9a1e-457fc63ce74f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526518 Nov 09 04:59:22.838944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 297/598] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 04:59:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 04:59:22.848262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4a8ec01f-daa4-4b66-87f4-ae645ecc8c33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:22.848870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4a8ec01f-daa4-4b66-87f4-ae645ecc8c33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:22.852506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] HTTP exception thrown: Instance 7a380611-e828-486c-b04d-218365157ced could not be found. Nov 09 04:59:22.853253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] Returning 404 to user: Instance 7a380611-e828-486c-b04d-218365157ced could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:59:22.854709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-11553648-d235-4d4f-8734-a337316437ff tempest-VolumesNegativeTest-2133685423 tempest-VolumesNegativeTest-2133685423-project] 10.222.0.41 "GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced" status: 404 len: 111 microversion: 2.1 time: 0.030468 Nov 09 04:59:22.860854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 302/599] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:22 2021] GET /compute/v2.1/servers/7a380611-e828-486c-b04d-218365157ced => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 04:59:22.903206 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4a8ec01f-daa4-4b66-87f4-ae645ecc8c33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:22.911302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4a8ec01f-daa4-4b66-87f4-ae645ecc8c33 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1218 microversion: 2.1 time: 0.066327 Nov 09 04:59:22.922454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 298/600] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:22 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:23.157581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:23.158717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:23.166476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.167314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.168453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.169353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.345994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:23.356343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1ad183ae-0aaf-4b87-b5e8-557beb89fd54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.212623 Nov 09 04:59:23.357033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 303/601] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:23.583597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:23.584591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:23.591898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.592258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.592994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.593450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.706211 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:23.707299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:23.714040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.714477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.715275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.715729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.740266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7e1cc21a-7b76-4346-a167-29bd071f6806 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.151277 Nov 09 04:59:23.741899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 299/602] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:23 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:23.834997 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3f85106c-d0af-4016-a2a2-4248b06a7c73 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.132251 Nov 09 04:59:23.835605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 304/603] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:23 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:23.938147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:23.938147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:23.943497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.944106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:23.945033 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:23.945466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.008428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:24.021084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-55a28bc2-8d97-4a20-b3d7-84f0df5bc3cf tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1270 microversion: 2.1 time: 0.094889 Nov 09 04:59:24.021932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 300/604] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:23 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:24.375260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:24.375925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:24.384287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:24.385568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.386363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:24.386802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.541736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:24.550848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bcc35510-be48-4cb6-8e5f-703164dadb01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.179949 Nov 09 04:59:24.551428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 305/605] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:24.752698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:24.753621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:24.760540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:24.760982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.761761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:24.762188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.847874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:24.849400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:24.855794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:24.856343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.857197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:24.857708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:24.867508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-82d71e0f-7703-4b77-9916-ed5eb1bc3e4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.118361 Nov 09 04:59:24.872006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 301/606] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:24 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:24.991600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4f9272ae-ed25-4ab0-b37c-be2f834dfb99 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.147841 Nov 09 04:59:24.992551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 306/607] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:24 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:25.046482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:25.047174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:25.054437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.055132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.055971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.056577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.252748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:25.263080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-20e2f66c-7c4d-46d8-a454-001ff95fa712 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.219906 Nov 09 04:59:25.265054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 302/608] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:25 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:25.572971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:25.573758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:25.580315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.580862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.581722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.582234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.727236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:25.736321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-33e466bd-9f58-4df2-af9a-a0004441e1bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.168211 Nov 09 04:59:25.736888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 307/609] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:25.879807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:25.880872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:25.889850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.890294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.891322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.891675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.954381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-d60fa3d1-ccfb-4834-8673-fecca481e062 req-d8b47959-37d2-45f9-a933-4d535c92502d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ab8304-4bda-45a0-8fee-112678f052c1", "tag": "f24686e9-c45d-4fef-aa52-368d9d4a68a7"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:25.956004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:25.956004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:59:25.966543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d60fa3d1-ccfb-4834-8673-fecca481e062 req-d8b47959-37d2-45f9-a933-4d535c92502d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:25.967022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d60fa3d1-ccfb-4834-8673-fecca481e062 req-d8b47959-37d2-45f9-a933-4d535c92502d service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:25.978157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-d60fa3d1-ccfb-4834-8673-fecca481e062 req-d8b47959-37d2-45f9-a933-4d535c92502d service nova] Creating event network-changed:f24686e9-c45d-4fef-aa52-368d9d4a68a7 for instance d9ab8304-4bda-45a0-8fee-112678f052c1 on hv-cinder-81713 Nov 09 04:59:25.983350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-d60fa3d1-ccfb-4834-8673-fecca481e062 req-d8b47959-37d2-45f9-a933-4d535c92502d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032686 Nov 09 04:59:25.984001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 308/610] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:25.994780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-93c4b530-8b61-4da5-9060-71d3a5a4526f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.118521 Nov 09 04:59:25.995437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 303/611] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:25 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:26.005460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:26.006454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:26.013026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:26.013469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:26.014244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:26.014678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:26.138241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6296da63-bfc7-451d-82b6-ebbb3f2f0a08 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.136510 Nov 09 04:59:26.138928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 309/612] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:26 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:26.282947 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:26.283612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:26.290609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:26.291054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:26.291860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:26.293688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:26.559704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:26.571835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0d7ce606-8a6c-41c9-a7bf-1ee6b63f94ac tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.293200 Nov 09 04:59:26.573028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 304/613] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:26 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:26.753790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:26.754753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:26.761714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:26.762487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:26.763968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:26.764562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:26.903808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:26.913978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-df797725-b4a3-4533-9313-20de0115feef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.164240 Nov 09 04:59:26.914572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 310/614] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:27.006119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:27.007161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:27.014629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.017735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.018580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.019021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.151357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:27.152297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:27.158321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.158768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.159539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.159995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.200888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-99dceac5-763b-4d65-82e6-72e2039fdc16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.198219 Nov 09 04:59:27.201536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 305/615] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:27 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:27.590267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:27.590954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:27.597794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.598240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.599002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.599481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.665190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-03837146-ac03-48c9-b603-c29a8d0e371c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.518555 Nov 09 04:59:27.665839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 311/616] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:27 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:27.727923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:27.736160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4d185ee3-80b1-40a2-9d25-ec5a10fc4c16 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.150414 Nov 09 04:59:27.736778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 306/617] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:27 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:27.932183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:27.932866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:27.939601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.940079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:27.940837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:27.941265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.075707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:28.084663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0b57486c-540a-4e02-8748-33e5e5215a61 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.157006 Nov 09 04:59:28.085235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 312/618] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:28.212610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:28.213525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:28.219789 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:28.220234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.221002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:28.221436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.544723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-051dc47d-b780-485f-ab5d-1fd5e012e135 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.335654 Nov 09 04:59:28.545371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 307/619] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:28 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:28.676049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:28.676945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:28.683594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:28.684080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.684880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:28.685314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.753500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:28.754178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:28.760944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:28.761382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.762134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:28.762555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:28.805157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e641f6e0-1dbf-4a27-a6bc-8489dad9233b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.132789 Nov 09 04:59:28.805800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 313/620] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:28 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:28.893908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:28.901717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c51d4ae1-f004-49ac-84b6-41bfd0c0e957 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.152330 Nov 09 04:59:28.902277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 308/621] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:28 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:29.102536 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:29.103229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:29.110109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.110562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.111341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.111819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.244566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:29.252192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a9c503a0-5961-4dad-893d-955e3a9de513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.153719 Nov 09 04:59:29.252749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 314/622] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:29.556406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:29.557833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:29.564091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.564563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.565332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.565761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.749325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5e02fc58-9efd-4cd9-81ef-6ddc95f521bf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.196286 Nov 09 04:59:29.750413 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 309/623] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:29 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:29.817148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:29.818114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:29.824467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.824910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.825676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.826110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.918965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:29.919672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:29.926687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.927122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.927899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:29.928322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:29.928778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fdb5c44b-177a-4df5-ac86-4fe793b246ba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.115249 Nov 09 04:59:29.929662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 315/624] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:29 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:30.062722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:30.069839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ab5c88cf-8b04-46f4-ab10-ed5d6bc0a7a1 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.155370 Nov 09 04:59:30.070399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 310/625] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:29 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:30.270469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:30.271086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:30.277922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:30.278370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:30.279152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:30.279878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:30.410803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:30.419583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7207f19c-b842-4c8f-a655-8757938a96f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.153252 Nov 09 04:59:30.420183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 316/626] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:30.761673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:30.762618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:30.769139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:30.769678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:30.770474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:30.770903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:30.924004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-208d9b7f-a600-433e-92c6-b82a36b91c77 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.166101 Nov 09 04:59:30.924638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 311/627] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:30 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:30.940341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:30.941262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:30.947534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:30.948023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:30.948793 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:30.949227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:31.045461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2c61f2a0-57a6-4b72-8cc9-a52910e17b94 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.108671 Nov 09 04:59:31.046073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 317/628] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:30 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:31.087323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:31.088489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:31.095313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:31.095790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:31.096553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:31.096983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:31.223762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:31.231392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2a8f070a-b802-4ffa-96ad-9f5ac9991615 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.148088 Nov 09 04:59:31.231993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 312/629] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:31 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:31.438747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:31.439940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:31.448046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:31.448518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:31.449282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:31.449716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:31.584095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:31.592278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-46e3dcfb-afc7-4fd7-94b0-cb62a0f39512 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.158835 Nov 09 04:59:31.592825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 318/630] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:31.935337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:31.936283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:31.942680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:31.943244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:31.943952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:31.944389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.057830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:32.059350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:32.060384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c7dbd2f3-7b45-4755-ab76-39889ccd33fb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.128298 Nov 09 04:59:32.061855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 313/631] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:31 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:32.065872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:32.066323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.067097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:32.067534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.184703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c26d4c9f-d475-4389-8e04-718ee60f47a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.130392 Nov 09 04:59:32.185349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 319/632] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:32 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:32.248561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:32.249253 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:32.256080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:32.256531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.257300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:32.257732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.395093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:32.402448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-697046df-c6db-40a9-bae9-7900394c19aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.158040 Nov 09 04:59:32.403012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 314/633] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:32 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:32.609269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:32.610121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:32.616888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:32.617340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.618123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:32.618570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:32.748498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:32.756588 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-36a596d7-0e2e-4c26-a2cb-37b2e80dda5a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.151381 Nov 09 04:59:32.757151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 320/634] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:33.074999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:33.076516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:33.083136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.083576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.084387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.084814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.196701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:33.197540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:33.203770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.204219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.205013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.205437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.217007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-214928ef-1eb9-402e-902d-3b0c758a8eb3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.147017 Nov 09 04:59:33.218615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 315/635] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:33 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:33.324993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d0cf757f-aa19-4a2e-9909-0da58a199920 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.131932 Nov 09 04:59:33.325883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 321/636] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:33 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:33.420074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:33.420758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:33.427490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.427953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.428705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.429130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.556422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:33.564117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e2ac77b7-7fb8-44db-a383-11869e5b940f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.148217 Nov 09 04:59:33.564673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 316/637] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:33 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:33.775888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:33.776663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:33.783780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.784229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.784998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:33.785435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:33.914221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:33.922435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-66ffcace-99c9-4ad0-97c0-423ca22d4c8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.152633 Nov 09 04:59:33.923030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 322/638] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:34.228970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:34.229879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:34.236113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.236554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.237318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.237746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.336308 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:34.337232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:34.343509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.343986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.344760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.345194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.562593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e0bda1f6-a75d-44e5-8d99-8c3f65192a9e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.229671 Nov 09 04:59:34.563166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 323/639] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:34 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:34.581815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f87f8251-1a17-4521-b988-814483f84d92 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.356836 Nov 09 04:59:34.581978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:34.585700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 317/640] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:34 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:34.585850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:34.589813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.590254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.591024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.591456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.723221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:34.731546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e177c61b-1454-486e-8003-fb903d865d9c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.153606 Nov 09 04:59:34.732140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 324/641] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:34 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:34.939861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:34.940552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:34.947845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.948294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:34.949089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:34.949521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.076780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:35.084932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1745907b-514c-4db4-baac-17e40ca1d9be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.149115 Nov 09 04:59:35.085486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 318/642] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:35.574809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:35.575835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:35.582121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:35.582569 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.583345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:35.583819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.593274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:35.594237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:35.600455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:35.600917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.601669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:35.602097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.696135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5f86df98-2052-4254-80b8-62a5d759c55a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.125510 Nov 09 04:59:35.696797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 325/643] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:35 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:35.726571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b8e86ba1-f5aa-489d-ba48-d937dd8afb16 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.136790 Nov 09 04:59:35.727223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 319/644] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:35 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:35.749124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:35.749817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:35.756765 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:35.757214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.757999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:35.758433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:35.889590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:35.897441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ec645488-c4c2-4a50-9ea5-69ab2407c264 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.152280 Nov 09 04:59:35.898008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 326/645] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:35 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:36.102908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:36.103601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:36.110485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.111172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:36.111996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.112426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:36.126571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-a406c6c9-4d8f-4e38-ad61-23ebdab9ea5f req-8960579b-5663-4a34-9260-ad7ce9535e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ab8304-4bda-45a0-8fee-112678f052c1", "name": "network-vif-plugged", "status": "completed", "tag": "f24686e9-c45d-4fef-aa52-368d9d4a68a7"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:36.128629 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:59:36.128629 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 04:59:36.139272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-a406c6c9-4d8f-4e38-ad61-23ebdab9ea5f req-8960579b-5663-4a34-9260-ad7ce9535e0e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.139900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-a406c6c9-4d8f-4e38-ad61-23ebdab9ea5f req-8960579b-5663-4a34-9260-ad7ce9535e0e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:36.154785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-a406c6c9-4d8f-4e38-ad61-23ebdab9ea5f req-8960579b-5663-4a34-9260-ad7ce9535e0e service nova] Creating event network-vif-plugged:f24686e9-c45d-4fef-aa52-368d9d4a68a7 for instance d9ab8304-4bda-45a0-8fee-112678f052c1 on hv-cinder-81713 Nov 09 04:59:36.159720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-a406c6c9-4d8f-4e38-ad61-23ebdab9ea5f req-8960579b-5663-4a34-9260-ad7ce9535e0e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037368 Nov 09 04:59:36.160602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 327/646] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 04:59:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:36.262599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:36.271170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1084320f-c998-4af2-a77c-5753eee201a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.172282 Nov 09 04:59:36.271982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 320/647] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:36.708804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:36.709734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:36.715813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.716259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:36.717032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.717465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:36.737973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:36.738877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:36.746286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.746722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:36.747482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:36.747937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:37.180778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-da96d25f-7f4c-44f5-bc7f-afdcfa028fa1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.476388 Nov 09 04:59:37.184681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 328/648] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:36 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:37.186167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:37.186857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:37.193595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:37.194046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:37.194816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:37.195252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:37.218816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9ad7f0f6-898c-40e0-b700-aafa196e0a06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.484207 Nov 09 04:59:37.219707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 321/649] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:36 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:37.288690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:37.289792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:37.296886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:37.297575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:37.298577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:37.299200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:37.330073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:37.337387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c074958d-a4e8-4398-aa4d-cfbff9ce4ce9 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.154819 Nov 09 04:59:37.338534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 329/650] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:37 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:37.503564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:37.513964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-531b0669-bb84-4f84-b340-02ceeecb8804 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.229315 Nov 09 04:59:37.514549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 322/651] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:38.192322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:38.193280 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:38.199606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.200086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.200865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.201302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.231686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:38.232634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:38.238751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.239201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.240013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.240449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.309460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2f79ffee-2c0b-4d65-bb0f-0ed6547bd927 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.120656 Nov 09 04:59:38.310099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 330/652] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:38 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:38.348467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-47a000a5-7df1-4d8f-bb3d-ff5422c44ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.121228 Nov 09 04:59:38.349099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 323/653] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:38 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:38.354810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:38.355519 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:38.362389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.362829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.363601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.364077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.496849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:38.503954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85adb5fe-2e21-48ce-a90b-b3d452a0f4dd tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1318 microversion: 2.1 time: 0.153580 Nov 09 04:59:38.504519 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 331/654] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:38 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:38.531324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:38.532065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:38.538858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.539297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.540108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:38.540656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:38.669891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:38.677897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0f415ac7-4ad1-46a5-9c09-ff729329bc5f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.150894 Nov 09 04:59:38.678456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 324/655] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:39.320415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:39.321328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:39.328096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.328543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.329315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.329744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.359609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:39.360541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:39.366665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.367112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.367906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.368340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.455630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cf8b3fd3-64d0-4e4c-9995-ad9c5d55ced8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.138747 Nov 09 04:59:39.456294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 332/656] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:39 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:39.485051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-867f524d-4fe6-4882-a74a-0f37df79f4db tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.128783 Nov 09 04:59:39.485696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 325/657] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:39 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:39.524110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:39.524907 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:39.532586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.533037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.533816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.534255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.661471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:39.669732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e85bfdb1-c748-4580-a200-07107f44a096 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1508 microversion: 2.1 time: 0.149909 Nov 09 04:59:39.670304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 333/658] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:39 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:39.694325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:39.695024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:39.702046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.702496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.703305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:39.703768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:39.837167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:39.846311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5ddcee09-388f-4388-9e65-07999dff7e55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.155956 Nov 09 04:59:39.846980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 326/659] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:40.467651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:40.468562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:40.474931 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:40.475384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:40.476221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:40.476656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:40.496346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:40.497263 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:40.503497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:40.503983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:40.504746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:40.505174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:40.705052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-986429aa-5d39-4e29-9a34-58f3c075da0c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.241479 Nov 09 04:59:40.705929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 334/660] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:40 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:40.737225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-da2b0cbe-4fac-4053-80c5-1884e61b3e3a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.244252 Nov 09 04:59:40.737789 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 327/661] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:40 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:40.864255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:40.864948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:40.872327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:40.872776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:40.873554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:40.873988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:41.004250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:41.013030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3192deba-9b4b-4c34-97cd-722e32a73e38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.152803 Nov 09 04:59:41.013591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 335/662] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:41.716334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:41.717444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:41.724370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:41.724806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:41.725555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:41.725977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:41.749083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:41.750102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:41.756363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:41.756804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:41.757576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:41.758005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:41.829698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2f3ba9c4-324a-46fd-b7da-7454b646d20a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.117319 Nov 09 04:59:41.830272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 328/663] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:41 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:41.870429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fa7ce695-5858-4c21-af33-23b74c7da4d0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.124828 Nov 09 04:59:41.871049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 336/664] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:41 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:42.016927 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5636f1d-d024-4a24-86ee-ab03bc1b9586"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:42.018046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:42.026038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.026675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.027708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.028381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.031884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:42.032629 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:42.039129 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.039577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.040996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.041443 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.179550 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:42.187558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b4a917e7-c588-4439-9538-ccdf6b9a7a88 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.160759 Nov 09 04:59:42.188151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 337/665] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:42.276811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-691ea75e-7e53-4edc-a153-1eb82d607200 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "POST /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263716 Nov 09 04:59:42.277395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 329/666] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:59:42 2021] POST /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:42.841390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:42.842216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:42.849008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.849507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.850353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.850784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.882110 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:42.883092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:42.889841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.890283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.891096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:42.891528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:42.978151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3bae739d-0b74-430f-89bb-cbb4384b7ce3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.140374 Nov 09 04:59:42.978788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 338/667] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:42 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:43.020124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-afb0850a-4aa4-424b-abb9-a59261654e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.142357 Nov 09 04:59:43.020771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 330/668] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:42 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:43.205337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:43.206060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:43.213600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:43.213991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:43.214758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:43.215223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:43.341975 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:43.350168 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c5ecd7ff-d720-4775-8faf-7facc23bd8e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.148886 Nov 09 04:59:43.350907 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 339/669] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:43.989731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:43.990718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:43.998042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:43.998479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:43.999232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:43.999750 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.031609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:44.032544 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:44.038668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:44.039105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.039895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:44.040831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.169360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0ee3fcf7-bf5c-480b-9e8b-b6f82e80ec56 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.183524 Nov 09 04:59:44.169984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 331/670] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:43 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:44.175015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35b8c003-c5b9-43bc-b40f-db6d943de3e3", "device": "/dev/sdb"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:44.176736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:44.184040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:44.184584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.185377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:44.185803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.189024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f198f2dc-7d47-4c54-a84f-1d4f6feb97e3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28177 microversion: 2.1 time: 0.161114 Nov 09 04:59:44.190058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 340/671] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:44 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28177 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:44.366541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:44.367244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:44.374164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:44.374613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.375385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:44.375859 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:44.450463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b20e0846-f31f-4567-945e-6afbc3abd3ff tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "POST /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278803 Nov 09 04:59:44.451147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 332/672] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 04:59:44 2021] POST /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:44.517856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:44.528839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-967d27d4-76b6-40de-8f82-673be2823e6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.166232 Nov 09 04:59:44.529698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 341/673] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:45.182379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:45.183487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:45.189602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:45.190039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:45.190793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:45.191216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:45.200916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:45.201832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:45.208037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:45.208481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:45.209247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:45.209678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:45.349428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2ada19b7-2a0f-412e-a01f-0aa6e80a047d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28468 microversion: 2.1 time: 0.152550 Nov 09 04:59:45.350100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 342/674] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:45 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:45.365655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d7388578-b924-41a0-a3b2-f51fd6c8976a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.188170 Nov 09 04:59:45.366286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 333/675] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:45 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:45.546860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:45.547550 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:45.554612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:45.555060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:45.555865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:45.557110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:45.692797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:45.701389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e50f61f5-46cb-4500-a540-01922ed0f3e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.158359 Nov 09 04:59:45.701978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 343/676] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 04:59:46.361485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:46.362518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:46.369982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:46.370438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:46.371209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:46.371660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:46.377556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:46.378460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:46.385204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:46.385642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:46.386417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:46.386846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:46.488392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bb178f13-dddf-4023-bc84-e32f2cc3be4c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28468 microversion: 2.1 time: 0.130742 Nov 09 04:59:46.489051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 334/677] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:46 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28468 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:46.508775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fefaa12f-6150-4f2b-bce3-862a28843672 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.134683 Nov 09 04:59:46.509667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 344/678] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:46 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:46.719085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:46.719793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:46.726971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:46.727416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:46.728799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:46.729256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:46.860452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:46.868827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-acdddb1d-9d14-43cb-b907-83076537c15d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.153651 Nov 09 04:59:46.869322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 335/679] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:47.500469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:47.501468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:47.508318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:47.508761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:47.509532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:47.509967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:47.519914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:47.520831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:47.527510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:47.527983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:47.528755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:47.529493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:47.632568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6b02e1f6-e390-4262-8bd9-b761b26bedc4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28634 microversion: 2.1 time: 0.135897 Nov 09 04:59:47.636937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 345/680] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:47 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:47.663255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f2827378-5558-4e1f-8683-360fc80e3507 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.146832 Nov 09 04:59:47.663929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 336/681] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:47 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:47.887060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:47.887773 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:47.894805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:47.895254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:47.896060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:47.896496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.029984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:48.038451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-54b52229-c757-40fa-9c82-907ba70ca845 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1548 microversion: 2.1 time: 0.155737 Nov 09 04:59:48.039272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 346/682] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:48.057329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:48.057899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:48.064648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.065088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.065850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.066278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.183182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] HTTP exception thrown: Cannot 'detach_volume' instance 367541e4-c608-43b0-90da-677a42dc9b16 while it is in vm_state rescued Nov 09 04:59:48.183804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Returning 409 to user: Cannot 'detach_volume' instance 367541e4-c608-43b0-90da-677a42dc9b16 while it is in vm_state rescued {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 04:59:48.184635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5371e639-1594-401e-8469-fa0b2a9da583 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "DELETE /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments/85a2f6be-f1c2-4526-820d-29793c6c4e3e" status: 409 len: 152 microversion: 2.1 time: 0.132072 Nov 09 04:59:48.185182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 337/683] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 04:59:48 2021] DELETE /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments/85a2f6be-f1c2-4526-820d-29793c6c4e3e => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 09 04:59:48.193230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:48.193786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:48.200531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.201004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.201765 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.202194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.263665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-77faac57-9bf0-41ae-8459-2a53deb17297 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action" status: 202 len: 0 microversion: 2.1 time: 0.073872 Nov 09 04:59:48.267393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 347/684] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:48 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:48.272584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:48.274003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:48.280555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.281002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.281893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.282194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.645856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:48.647671 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:48.653953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.654668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.655914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.656679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.696614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:48.704742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5ba15730-69d6-4026-be0d-75c1312c61b1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1556 microversion: 2.1 time: 0.436021 Nov 09 04:59:48.705540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 338/685] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1556 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:48.716029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:48.716029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:48.716964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.717403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.718278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:48.718706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:48.804769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bf61aaa3-3517-47f8-a17c-69fc00962d68 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.163475 Nov 09 04:59:48.805709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 348/686] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:48 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:48.871578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d67d2217-711b-4c85-bd23-9d977e816ceb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.165020 Nov 09 04:59:48.872542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 339/687] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:48 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:49.722361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:49.723068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:49.730372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.730829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.731607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.732116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.817663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:49.818785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:49.825732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.826179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.826957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.827391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.875895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:49.883797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e1d128b0-b05d-4602-b9ac-30eb04b60e60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1556 microversion: 2.1 time: 0.165357 Nov 09 04:59:49.884942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 349/688] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:49.889232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:49.889716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:49.895190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.895545 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.896517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.897001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.916798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d9caf4d1-2ee5-4eb7-98cf-a3d8b0add1d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.102311 Nov 09 04:59:49.918294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 340/689] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:49 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:49.924758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:49.925754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:49.933386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.933839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.934616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:49.935045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:49.976260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lazy-loading 'services' on Instance uuid d9ab8304-4bda-45a0-8fee-112678f052c1 {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:59:50.044710 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-16a20457-d19b-4a83-997a-a95d4048f6e7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments/f5636f1d-d024-4a24-86ee-ab03bc1b9586" status: 202 len: 0 microversion: 2.1 time: 0.158564 Nov 09 04:59:50.045318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 350/690] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 04:59:49 2021] DELETE /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments/f5636f1d-d024-4a24-86ee-ab03bc1b9586 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:50.054138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:50.055191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:50.061549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:50.062142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:50.062962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:50.063397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:50.094810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e3a6b8ab-38cb-4a4f-a43b-20a607e6c4ab tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Nov 09 04:59:50.095383 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 351/691] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:50 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:50.123194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ff916cbd-3f0a-40d3-80a6-68b91995e7f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.203206 Nov 09 04:59:50.123869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 341/692] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:49 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:50.901501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:50.902111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:50.908756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:50.909205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:50.909981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:50.910418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:50.929316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:50.930306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:50.937776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:50.938211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:50.938976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:50.939430 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:51.043212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:51.050993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0317d224-206f-40fb-90d3-c61b658ecc09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1556 microversion: 2.1 time: 0.153115 Nov 09 04:59:51.051557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 352/693] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:51.106663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:51.107559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:51.107960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7295ea58-516a-46b9-8291-cb957725beb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.182428 Nov 09 04:59:51.108627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 342/694] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:50 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:51.113563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:51.114009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:51.114774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:51.115202 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:51.136000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:51.137052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:51.143787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0435a173-fe38-4935-8ae2-181f0393df19 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041423 Nov 09 04:59:51.143921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:51.144296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:51.144433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 353/695] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:51 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:51.145068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:51.145496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:51.251942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-36aa1884-2854-4dd0-9761-d081896773e5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.119683 Nov 09 04:59:51.252752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 343/696] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:51 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:52.066822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:52.067421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:52.074194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.074639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.075409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.075869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.120604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:52.121511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:52.128234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.128673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.129440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.129863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.205684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:52.213391 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a6f66fb5-1bcf-4beb-88a3-a32437ea608b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1556 microversion: 2.1 time: 0.150246 Nov 09 04:59:52.213953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 354/697] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:52.218307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:52.219199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:52.224612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.225062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.225832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.226265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.250444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-418b57c7-9d1e-4360-a770-5307e6a3537d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.134372 Nov 09 04:59:52.251098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 344/698] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:52 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:52.255574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3be611f2-8146-40e9-8f10-12a587130ac5 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 Nov 09 04:59:52.256152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 355/699] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:52 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:52.263207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:52.264221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:52.271247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.271722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.272481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:52.272929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:52.393570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6816b2b6-e455-41d8-8e26-a1e527c66295 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.134089 Nov 09 04:59:52.394187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 345/700] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:52 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:53.230745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:53.231297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:53.237469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.237908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.238674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.239107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.262659 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:53.263698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:53.270574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.271016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.271807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.272233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.367186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 04:59:53.375040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1c3c62f2-5807-4c57-9eb4-a126421e662a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1562 microversion: 2.1 time: 0.148530 Nov 09 04:59:53.375602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 356/701] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 04:59:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 04:59:53.379961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:53.380850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:53.386250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.386705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.387485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.387947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.390824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1649f155-33b4-4060-851b-8ad4235d92ea tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.131849 Nov 09 04:59:53.396603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 346/702] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:53 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:53.406398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:53.407642 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:53.414419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.414869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.416260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.416687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.421056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-78b31023-856b-4a54-9b61-a1d701de75dc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Nov 09 04:59:53.421056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 357/703] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:53 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:53.443113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:53.443603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:53.449543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.449992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.450771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.451206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.519882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-81f17860-d8b7-4038-86ea-166b224f2d67 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.117646 Nov 09 04:59:53.520719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 347/704] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:53 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:53.526329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lazy-loading 'services' on Instance uuid 367541e4-c608-43b0-90da-677a42dc9b16 {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 04:59:53.594333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f0d60170-df2a-450c-a515-a1c8e78ac786 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "DELETE /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments/85a2f6be-f1c2-4526-820d-29793c6c4e3e" status: 202 len: 0 microversion: 2.1 time: 0.154636 Nov 09 04:59:53.595021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 358/705] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 04:59:53 2021] DELETE /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments/85a2f6be-f1c2-4526-820d-29793c6c4e3e => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 04:59:53.604279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:53.605270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:53.611468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.611938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.612703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:53.613133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:53.643258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f3e08bc6-b50d-474d-88e1-6bcd55b05132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Nov 09 04:59:53.643846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 348/706] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:54.405058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:54.406223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:54.412362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.412812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.413587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.414020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.431820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:54.432746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:54.438931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.439368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.440173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.440585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.470971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-948486c5-f267-4aae-af9d-2b7935a84c4c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Nov 09 04:59:54.471525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 349/707] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:54 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:54.507822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-315c7c0f-033d-4ce8-9f17-6825c3e3a175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.107327 Nov 09 04:59:54.508457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 359/708] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:54 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:54.531333 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:54.532264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:54.538377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.538816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.539563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.540011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.644281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-69ab763e-54fa-4282-acc9-0a991f18d4a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.116547 Nov 09 04:59:54.644952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 350/709] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:54 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:54.655615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:54.656572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:54.663386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.663855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.664656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:54.665088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:54.693585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d14e9f99-58ce-440a-9225-4cec15e778ab tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Nov 09 04:59:54.694122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 360/710] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:55.483378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:55.484390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:55.493208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.494295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.495131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.495642 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.519780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:55.520696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:55.527408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.528023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-60c27cec-3b8f-4993-baef-c6521b641023 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Nov 09 04:59:55.528164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.528670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 351/711] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:55 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:55.528889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.529583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.647329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9ef6a2d6-e048-48ae-a6e7-d8907090b724 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.131088 Nov 09 04:59:55.648040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 361/712] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:55 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 04:59:55.656479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:55.657381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:55.663675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.664123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.664887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.665901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.705884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:55.706863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:55.714297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.714738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.715504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:55.715968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:55.749198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8393189-cb8e-4250-9012-c86b02bcb2e9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Nov 09 04:59:55.750146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 362/713] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:55.916964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-68e0400e-7584-45f0-b57a-9fc8f34a3d93 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.264198 Nov 09 04:59:55.917630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 352/714] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:55 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:56.539882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:56.540818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:56.547286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.547733 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.548583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.549023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.583386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85034ae1-ca2f-4913-bda1-a58b01ef0fb4 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047432 Nov 09 04:59:56.583979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 363/715] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:56 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:56.660543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:56.661583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:56.668839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.669286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.670534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.670534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.760636 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:56.761694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:56.768011 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.768459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.769222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.769651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.777497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c997d5e8-f75a-4dca-87e8-433d8b05b438 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.120842 Nov 09 04:59:56.778357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 353/716] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:56 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:56.798663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9d01c57a-6459-4c2d-be28-e1d10aa7971c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041704 Nov 09 04:59:56.799137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 364/717] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:56.929016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:56.930017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:56.937399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.937844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:56.938609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:56.939046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.059996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-533eab60-7e26-429a-9f66-98b96b8893c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.134782 Nov 09 04:59:57.060823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 354/718] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:56 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:57.594266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:57.595168 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:57.601479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:57.601917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.602678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:57.603107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.630649 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cc7cbb15-b2b7-4656-83c5-1df895974b21 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040168 Nov 09 04:59:57.631186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 365/719] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:57 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:57.789046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:57.790049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:57.796780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:57.797214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.797965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:57.798392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.810234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:57.811139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:57.816819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:57.817258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.818271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:57.818791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:57.848045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-50c8a8b0-4bfe-417c-ad64-3cb2527bce15 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042004 Nov 09 04:59:57.848516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 366/720] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:57.913240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ef4d80c9-32ca-4e02-bf8c-5bc0f2f3d8b3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.128032 Nov 09 04:59:57.913879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 355/721] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:57 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 04:59:58.071360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:58.072776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:58.078872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.079311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.080097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.080522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.641970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:58.642978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:58.650250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.650684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.651437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.651917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.672764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-67e54377-fd7b-49cb-a6f8-5ce228039cd2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.604942 Nov 09 04:59:58.673805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 367/722] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:58 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 04:59:58.681568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4bd96471-fa3f-4cb8-8d5c-47213d81eb48 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Nov 09 04:59:58.682113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 356/723] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:58 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 04:59:58.860437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 04:59:58.861344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:58.868097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.868537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.869299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.869727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.898578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-233002a3-1dc4-4c4d-a6a8-e8df00a269e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Nov 09 04:59:58.899136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 368/724] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 04:59:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 04:59:58.924544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:58.925471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:58.931611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.932073 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:58.932826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:58.933251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:59.684951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 04:59:59.685853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 04:59:59.692053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:59.692495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 04:59:59.693259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 04:59:59.693688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:02.622574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dec7c1af-52c2-42bc-8d4b-9fa04646bdc8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 3.701504 Nov 09 05:00:02.623213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 357/725] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 04:59:58 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 3703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:02.628254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:02.629218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:02.637226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:02.637663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:02.638416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:02.638842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:02.667267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-01c68dd5-1b8e-4b56-83c2-cf062108169f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042800 Nov 09 05:00:02.667830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 358/726] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:02 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:02.672011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:02.672874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:02.678690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:02.679130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:02.679922 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:02.680346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:02.708355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-15b6f01d-de90-4619-aa2f-b0f373ec30bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039520 Nov 09 05:00:02.708827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 359/727] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:02.893354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-068a01dc-27e6-4e48-93d0-9b8b4b412baf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 3.212454 Nov 09 05:00:02.894254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 369/728] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 04:59:59 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 3214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:00:03.636292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:03.636292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:03.641918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.642363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.643131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.643556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.678903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:03.679961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:03.688329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.688775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.689545 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.689975 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.719457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c1abe3aa-88e8-4683-af1f-fe2e2fe374aa tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044633 Nov 09 05:00:03.720067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 370/729] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:03 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 05:00:03.725653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:03.726548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:03.734707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.735148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.736481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.737155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.766312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-445c3cd0-b760-4870-bb09-09f27d90e023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Nov 09 05:00:03.767068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 371/730] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:03.801144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-456aa8d4-c208-4022-8156-0748de39b175 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.170550 Nov 09 05:00:03.802011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 360/731] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:03 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:03.905598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:03.906517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:03.912783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.913233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:03.914008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:03.914447 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:04.075877 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8c89d0ee-ae81-4209-b7a1-1ca60c3ee5a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.174476 Nov 09 05:00:04.076469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 372/732] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:03 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:04.778210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:04.779485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:04.786289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:04.786733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:04.787495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:04.787957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:04.813884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:04.814872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:04.817258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-af04d1de-f4da-4d7c-a291-3ac6d1ccce34 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043132 Nov 09 05:00:04.817822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 361/733] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:04.821884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:04.822273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:04.823755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:04.824196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:04.929178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3da36406-61b8-4976-8251-90d19d5b8ce2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.119113 Nov 09 05:00:04.931367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 373/734] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:04 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:05.087517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:05.088387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:05.094626 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:05.095068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:05.095862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:05.096292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:05.185028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-af1ead7b-3d09-4c41-8b20-1ca55b1104ea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.101163 Nov 09 05:00:05.185643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 362/735] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:05 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:05.829337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:05.830268 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:05.837070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:05.837521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:05.838297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:05.838813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:05.867671 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-88ebf673-d0af-48eb-8607-29b24b66bba9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Nov 09 05:00:05.868228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 374/736] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:05.941744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:05.942738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:05.949705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:05.950155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:05.950932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:05.951366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:06.108810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-93ead51a-2cb4-4b39-b4ed-78a4ad572fc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.170843 Nov 09 05:00:06.109374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 363/737] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:05 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:06.196580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:06.197493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:06.203685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:06.204130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:06.204898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:06.205326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:06.331889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-92e469dd-db97-44e9-acf3-10d7f4cfb62b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.138914 Nov 09 05:00:06.332532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 375/738] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:06 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:06.879743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:06.880740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:06.888128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:06.888572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:06.889341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:06.889774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:06.918299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-81f86571-4128-4e0a-a548-1551033fc45d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 Nov 09 05:00:06.918837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 364/739] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:07.121475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:07.122494 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:07.129297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:07.129789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:07.130520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:07.130953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:07.259763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e857dd6f-d1a2-42d2-9ef8-6eefde7cf649 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.142733 Nov 09 05:00:07.260444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 376/740] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:07 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:07.342774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:07.343704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:07.349938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:07.350382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:07.351142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:07.351575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:07.460652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-99706ab0-6669-4cac-869a-a83f24439b5f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.121377 Nov 09 05:00:07.461187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 365/741] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:07 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:07.930048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:07.931072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:07.937878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:07.938326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:07.939096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:07.939530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:07.969216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-46824a4e-a5df-4f9c-bfa1-02d9bb1abd8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Nov 09 05:00:07.969816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 377/742] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:08.271443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:08.272525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:08.279524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:08.280006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:08.280819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:08.281252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:08.386144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cb3b5845-56df-4971-9e2b-8cd38b1a7bd7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.118762 Nov 09 05:00:08.386784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 366/743] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:08 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:08.472418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:08.473335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:08.479533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:08.480012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:08.480816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:08.481251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:08.570236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9eddff5e-1f9e-486c-94a9-1b9367e229f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.101272 Nov 09 05:00:08.570857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 378/744] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:08 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:00:08.981586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:08.982607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:08.989493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:08.989938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:08.990702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:08.991131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:09.021623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7557dac7-c195-48cd-8870-33452e6f2232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Nov 09 05:00:09.022182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 367/745] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:09.398161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:09.399160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:09.406801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:09.407243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:09.408042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:09.408467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:09.513087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-65a8022c-ef66-492e-8c37-d4bd0c2c3b76 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.118330 Nov 09 05:00:09.513573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 379/746] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:09 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:09.582148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:09.583055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:09.589863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:09.590310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:09.591075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:09.591502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:09.703396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c641e702-1a12-4133-8dae-b77859c30a3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28590 microversion: 2.20 time: 0.124660 Nov 09 05:00:09.703998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 368/747] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:09 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28590 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:10.033620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:10.034574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:10.041881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:10.042330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:10.043114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:10.043557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:10.074272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-94ab7147-a7ab-4e85-a187-7c59429370f4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Nov 09 05:00:10.074814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 380/748] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:10.524485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:10.525484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:10.533322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:10.533765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:10.534527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:10.534956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:10.668281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a0df9531-7005-4e70-adeb-704bcaf167a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.147609 Nov 09 05:00:10.668923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 369/749] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:10 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:10.714732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:10.715662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:10.721999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:10.722434 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:10.723193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:10.723642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:10.855274 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-64750138-2cc8-453e-82f8-d518ce868a28 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 28864 microversion: 2.20 time: 0.144601 Nov 09 05:00:10.855933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 381/750] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:10 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 28864 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:11.086416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:11.087334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:11.094706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:11.095150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:11.095945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:11.096374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:11.123771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4b92d905-d79f-427f-a887-24e68f21724f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Nov 09 05:00:11.124316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 370/751] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:11.680529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:11.681531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:11.688900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:11.689345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:11.690119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:11.690557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:11.827175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-803a0d5f-f450-47dd-a591-b53c646cfe22 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.150522 Nov 09 05:00:11.828126 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 382/752] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:11 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:11.866099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:11.867008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:11.873332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:11.873775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:11.874558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:11.874989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:12.005990 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d784118f-e7e7-4a18-a4d5-8687f9f2fae7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 30474 microversion: 2.20 time: 0.143439 Nov 09 05:00:12.006613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 371/753] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:11 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 30474 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:12.134747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:12.136334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:12.143080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:12.143521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:12.144309 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:12.144739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:12.174641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a6b3031c-4048-4e5c-adc2-db009f881e65 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Nov 09 05:00:12.175190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 383/754] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:12.839031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:12.839978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:12.847197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:12.847658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:12.848436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:12.848883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:12.977448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-221d0750-7076-4e0a-bd6a-c7441e83cfe4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.142394 Nov 09 05:00:12.978095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 372/755] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:12 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:13.017613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:13.018547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:13.024776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:13.025223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:13.026020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:13.026465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:13.154963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3009d8e9-4a30-4343-9b4f-651dbee9d6a2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 31992 microversion: 2.20 time: 0.140938 Nov 09 05:00:13.155642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 384/756] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:13 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 31992 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:00:13.186915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:13.187941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:13.194721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:13.195170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:13.195979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:13.196410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:13.224999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a14a27ff-3b2d-42f0-a2c6-76ac7d01995d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Nov 09 05:00:13.225553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 373/757] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:13.989320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:13.990380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:13.997865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:13.998310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:13.999085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:13.999515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:14.096917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b5f0ac72-75fe-43d2-9e88-740cd77defca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.111423 Nov 09 05:00:14.097553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 385/758] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:13 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:14.168567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:14.169476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:14.176699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:14.177133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:14.177911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:14.178332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:14.236787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:14.237766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:14.244758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:14.245200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:14.245979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:14.246390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:14.276795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3af0ec84-a549-43fd-990e-0f092b8fdb8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Nov 09 05:00:14.277382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 386/759] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:14.285183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a63f9cbd-2fdb-431e-9e2d-f46503c557a0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 33011 microversion: 2.20 time: 0.122132 Nov 09 05:00:14.286018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 374/760] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:14 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 33011 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:15.108635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:15.109541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:15.115747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:15.116189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:15.116962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:15.117389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:15.227708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4f4c8bd8-91b6-47da-83b9-4fa3d2fd9d11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.122478 Nov 09 05:00:15.228420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 387/761] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:15 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:15.288870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:15.289893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:15.296731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:15.297171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:15.297282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:15.297963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:15.298204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:15.298388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:15.305009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:15.305460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:15.306244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:15.306682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:15.329784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-26224b4a-ba7e-4c0c-8831-55410aca5cd1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Nov 09 05:00:15.330349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 375/762] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:15.440697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-04e71593-0209-425e-b7e2-51563d7aeaf5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 33628 microversion: 2.20 time: 0.147289 Nov 09 05:00:15.441339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 388/763] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:15 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 33628 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:00:16.238757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:16.239580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:16.245835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:16.246277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:16.247032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:16.247454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:16.342242 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:16.343262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:16.351453 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-40149751-1455-455a-8dc1-12a8100e190a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.116237 Nov 09 05:00:16.351941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:16.351941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:16.352512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 376/764] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:16 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:16.352694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:16.353123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:16.382611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f64fe199-6186-4259-935d-4434b0605aff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Nov 09 05:00:16.383161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 389/765] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:16.453199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:16.454220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:16.460917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:16.461359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:16.462120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:16.462548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:16.585455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c7ba1b56-e13f-46f2-9332-dd8ca4c437d2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 34641 microversion: 2.20 time: 0.136093 Nov 09 05:00:16.586355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 377/766] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:16 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 34641 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:17.363025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:17.363883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:17.370078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:17.370525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:17.371294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:17.371756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:17.394569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:17.395549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:17.404737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:17.405176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:17.405936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:17.406357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:17.435879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1b0cf93b-d932-4907-aa0f-4c4220497b43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Nov 09 05:00:17.436435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 378/767] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:17.472696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0559a75b-a954-4616-9492-695273a57933 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.113302 Nov 09 05:00:17.473345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 390/768] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:17 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:17.597087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:17.597989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:17.604332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:17.604766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:17.605523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:17.605950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:17.734900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cbc2da11-1550-435a-9790-cac0dffeee0a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 35463 microversion: 2.20 time: 0.141297 Nov 09 05:00:17.735526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 379/769] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:17 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 35463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:18.448324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:18.449351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:18.456516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:18.456799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:18.457578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:18.458007 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:18.484584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:18.485591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:18.491034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ff7aa066-7dc0-4ffe-8289-b1b4386e7004 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047381 Nov 09 05:00:18.492617 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:18.492906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:18.493686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:18.494117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:18.494838 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 391/770] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:18.622622 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-68c9a35b-29d6-4127-ba53-43d7e9d20c0b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.141933 Nov 09 05:00:18.623286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 380/771] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:18 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:18.747028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:18.747885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:18.754439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:18.754887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:18.755680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:18.756122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:18.870914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-607fd0a2-e4dd-4710-876f-7fac4a978c30 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 36712 microversion: 2.20 time: 0.127918 Nov 09 05:00:18.871856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 392/772] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:18 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 36712 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:19.502143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:19.503128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:19.510021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:19.510464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:19.511226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:19.511684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:19.542495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a0b74579-e26e-4ec6-a3b1-ea44f4a12b81 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Nov 09 05:00:19.543067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 381/773] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:19.634590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:19.635590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:19.642418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:19.642864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:19.643643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:19.644093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:19.793162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-23dc2c86-f852-49e4-a322-5ee6b2ecf556 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.162364 Nov 09 05:00:19.793986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 393/774] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:19 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:19.915458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:19.916398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:19.922681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:19.923122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:19.923917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:19.924350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:20.072439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5a3df549-f05b-4f10-bcc4-8756e1e4a96a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 37954 microversion: 2.20 time: 0.160353 Nov 09 05:00:20.073531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 382/775] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:19 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 37954 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:20.554424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:20.555458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:20.562869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:20.563346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:20.564161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:20.564603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:20.595529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7728d16b-4b50-4372-bac6-fde2ba869bb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Nov 09 05:00:20.596127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 394/776] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:20.805130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:20.806035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:20.813411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:20.813879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:20.814638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:20.815065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:20.911680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d92a41a0-1602-457f-81ea-0a1c92581a5e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.110517 Nov 09 05:00:20.912284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 383/777] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:20 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:21.086285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:21.087191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:21.093841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:21.094284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:21.095049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:21.095481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:21.207228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8440a08a-507a-4dcb-854d-458a0839effb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 38141 microversion: 2.20 time: 0.124475 Nov 09 05:00:21.207886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 395/778] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:21 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 38141 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:21.607394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:21.608446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:21.615375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:21.615878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:21.617525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:21.617525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:21.646901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-67071a6b-6de2-45b1-87b8-58e680f4df41 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043613 Nov 09 05:00:21.647446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 384/779] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:21.922676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:21.923711 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:21.930589 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:21.931036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:21.931859 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:21.932808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:22.026190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d20c3fa5-5949-4a0e-a5c4-98a19802fd06 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.107419 Nov 09 05:00:22.026810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 396/780] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:21 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:22.218266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:22.219112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:22.225555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:22.226000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:22.226767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:22.227199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:22.340207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3cbe1df0-3c04-45b0-b469-0b2abc97add8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 38141 microversion: 2.20 time: 0.125343 Nov 09 05:00:22.340839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 385/781] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:22 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 38141 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:22.658984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:22.660008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:22.667420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:22.667889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:22.668674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:22.669109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:22.698108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8621358-437c-4da0-9deb-4abbea219279 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Nov 09 05:00:22.698662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 397/782] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:23.038373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:23.039392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:23.046260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:23.046697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:23.047451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:23.047906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:23.136033 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cb62d5e2-c0a0-464b-9956-428b366144b0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.100935 Nov 09 05:00:23.136670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 386/783] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:23 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:23.351592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:23.352567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:23.358819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:23.359266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:23.360068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:23.360501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:23.470445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0809ea33-a1ad-4958-b797-cbb57e98ddb8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 38141 microversion: 2.20 time: 0.122463 Nov 09 05:00:23.471064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 398/784] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:23 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 38141 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:00:23.709982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:23.711303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:23.717837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:23.718276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:23.719036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:23.719455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:23.749473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1d8da68f-fe69-40f3-aee9-a32651ce4796 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043594 Nov 09 05:00:23.750002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 387/785] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:24.148079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:24.149067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:24.156758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:24.157198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:24.157970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:24.158398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:24.265197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b1d83231-1a12-429f-9241-658b1ec3479f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.120890 Nov 09 05:00:24.265747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 399/786] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:24 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:24.482419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:24.483330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:24.490102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:24.490553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:24.491315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:24.491784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:24.605223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-67f6cd82-2a00-4135-a167-860bc5230d6b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 38141 microversion: 2.20 time: 0.126418 Nov 09 05:00:24.605868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 388/787] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:24 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 38141 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:24.761855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:24.762873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:24.769596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:24.770663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:24.771463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:24.771922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:24.801074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-25cb51da-a62d-47f7-98f4-5ee374d7e3a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Nov 09 05:00:24.801618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 400/788] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:25.277405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:25.278660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:25.285537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.285977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.286735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.287163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.373447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b89e80ca-0553-4fd3-9028-97ddb7b899b8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.100044 Nov 09 05:00:25.374058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 389/789] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:25 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:25.617124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:25.618178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:25.624411 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.624856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.625623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.626058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.744238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9079bbfd-f3ad-4bc7-af02-fcc3546af7a4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action" status: 200 len: 38284 microversion: 2.20 time: 0.130739 Nov 09 05:00:25.745148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 401/790] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:00:25 2021] POST /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/action => generated 38284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:00:25.755123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:25.755801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:25.762645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.763086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.763876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.764299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.787920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-612ccfbc-e1a5-4e52-9cd6-a9532496fb2c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/ips" status: 200 len: 152 microversion: 2.20 time: 0.036852 Nov 09 05:00:25.788475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 390/791] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Nov 9 05:00:25 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:25.813691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:25.814712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:25.821910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.823005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.823940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:25.824579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:25.856278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0caa792a-cbde-42c4-b261-9a331462efa0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047256 Nov 09 05:00:25.857013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 402/792] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:26.385707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:26.386671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:26.392843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:26.393286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:26.394046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:26.394477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:26.617616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0e3bfd37-41a6-4934-aea3-9dbef3f061fc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.236082 Nov 09 05:00:26.618296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 391/793] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:26 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:26.867424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:26.868372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:26.875167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:26.875648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:26.876436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:26.876884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:26.904893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f911f687-0762-410a-a8f4-79ca51c4380f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041185 Nov 09 05:00:26.905440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 403/794] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:27.630173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:27.631195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:27.638532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:27.638976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:27.639770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:27.640201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:27.737756 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e6de808f-f919-4079-9eb7-c134f942f574 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.111512 Nov 09 05:00:27.738631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 392/795] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:27 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:27.916451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:27.917424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:27.923385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:27.923866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:27.924678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:27.925112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:27.954265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fb779db7-0fdb-487a-b253-e5aab203d5e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Nov 09 05:00:27.954814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 404/796] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:28.748933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:28.749921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:28.756795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:28.757233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:28.758002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:28.758432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:28.869879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-af6b8c75-1895-4396-9b78-542330ae9fc6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.124758 Nov 09 05:00:28.870422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 393/797] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:28 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:28.965059 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:28.965976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:28.972241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:28.972689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:28.973462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:28.973899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:29.002924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-62788222-8844-42c4-8be7-99c83bb1030d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041550 Nov 09 05:00:29.003467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 405/798] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:29.882147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:29.883304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:29.890142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:29.890584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:29.891348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:29.891816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:29.992225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-02afba6e-638f-4bb9-9187-e5323d886be6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.113887 Nov 09 05:00:29.992824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 394/799] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:29 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:30.013363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:30.014275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:30.020416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:30.020868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:30.021678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:30.022114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:30.052093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-298f7d5b-1d68-4747-be6b-2f524abd173d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Nov 09 05:00:30.052688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 406/800] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:31.004360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:31.005385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:31.012773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:31.013217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:31.013975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:31.014404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:31.063781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:31.064684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:31.070819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:31.071261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:31.072057 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:31.073124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:31.102179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-84dc5e75-9b3d-4523-b11f-e52a3844c960 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Nov 09 05:00:31.102732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 407/801] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:31.135315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b0ec41c6-5d9d-4a6f-8301-3afb63c9ef46 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.134735 Nov 09 05:00:31.136003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 395/802] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:30 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:32.113457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:32.114361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:32.120536 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:32.120981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:32.121747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:32.122175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:32.146626 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:32.147661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:32.151180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-54542a1a-fdb3-47dc-9333-be9698cb95a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040813 Nov 09 05:00:32.151769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 408/803] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:32.155248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:32.155722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:32.156500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:32.156932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:32.257267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-00d6c6e7-200b-4c41-aeb1-3d1077a0a2c1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.114383 Nov 09 05:00:32.257813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 396/804] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:32 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:33.162055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:33.163036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:33.169840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:33.170282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:33.171044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:33.171472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:33.199337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7a6be7f6-91b2-4948-82da-7136c33c551b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040872 Nov 09 05:00:33.199840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 409/805] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:33.269149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:33.270173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:33.277690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:33.278390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:33.279155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:33.279586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:33.398813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-805e2f38-b7ab-4a1e-a51c-2aa67b295aa5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.133591 Nov 09 05:00:33.399456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 397/806] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:33 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:34.211195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:34.212212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:34.218700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:34.219150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:34.219953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:34.220392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:34.249367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-036516ba-b955-48ee-a3c2-3f50ae58702f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 Nov 09 05:00:34.249909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 410/807] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:34.410794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:34.411888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:34.419222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:34.419696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:34.420460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:34.420887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:34.536730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c5bd4af-0d6a-44df-afb6-bf9f9909c337 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.129992 Nov 09 05:00:34.537379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 398/808] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:34 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:35.261198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:35.262110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:35.268385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:35.268854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:35.269810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:35.270318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:35.301601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-053fc832-4c78-4052-9a9d-96e7de19b6f1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Nov 09 05:00:35.302271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 411/809] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:35.548604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:35.549593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:35.556921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:35.557437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:35.558212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:35.558643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:35.711473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3916d11b-54dd-4d5f-beea-0b77df6032a1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.166574 Nov 09 05:00:35.712090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 399/810] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:35 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:36.313271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:36.314176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:36.320361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:36.320803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:36.321570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:36.322001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:36.350475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5b23ee45-2bd3-4534-a22a-8e4c76f6c8f2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040887 Nov 09 05:00:36.351015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 412/811] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:36.723352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:36.724426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:36.731232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:36.731704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:36.732475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:36.732907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:36.859683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f2cd2b78-b3e5-4434-be35-b9265699d4a9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.140085 Nov 09 05:00:36.860265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 400/812] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:36 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:37.362026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:37.362964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:37.369720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:37.370169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:37.370940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:37.371374 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:37.399345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-38300ed0-41c9-49ec-aa90-07530835db3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Nov 09 05:00:37.399925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 413/813] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:37.871387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:37.872349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:37.880244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:37.881035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:37.882100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:37.882542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:37.988977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8a17fcb8-41cb-4b61-b116-308b8d5d0c48 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.121669 Nov 09 05:00:37.989719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 401/814] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:37 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:38.410707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:38.411603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:38.418578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:38.419018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:38.419816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:38.420251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:38.447918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5de51f35-b0e7-463a-9add-f471eefeeb74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 Nov 09 05:00:38.448485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 414/815] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:39.001292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:39.002289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:39.009156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:39.009648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:39.010959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:39.011386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:39.131122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-da7ef395-eba6-40ff-99d4-fbb5eae3fe5f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.133622 Nov 09 05:00:39.131803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 402/816] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:38 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:39.458193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:39.459104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:39.465479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:39.465928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:39.466709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:39.467138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:39.497989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-aa186af7-c031-4817-859c-1ca2c12bacf0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Nov 09 05:00:39.498795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 415/817] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:40.143938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:40.144932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:40.152398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:40.152847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:40.153876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:40.154308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:40.251901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-da1711ea-baa3-43a3-8b63-3c51603a243e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.111915 Nov 09 05:00:40.252418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 403/818] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:40 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:40.510018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:40.510803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:40.517186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:40.517623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:40.518395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:40.518894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:40.550324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ee60566a-b9d5-4cd6-bfb7-ca72dd78d5a7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Nov 09 05:00:40.550883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 416/819] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:41.263780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:41.264769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:41.271559 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:41.272030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:41.272786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:41.273306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:41.377195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-16391b10-fac7-4a3d-8db0-71e60a0f5039 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.117208 Nov 09 05:00:41.377824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 404/820] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:41 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:41.561851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:41.562761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:41.569112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:41.569781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:41.570336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:41.570773 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:41.599816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4009fe8a-09a6-4887-be18-bc35117f97fb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041668 Nov 09 05:00:41.600372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 417/821] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:42.389271 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:42.390268 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:42.397124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:42.397586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:42.398332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:42.398758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:42.482355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-faa07eac-e0e6-4b48-8b6f-58fde6bfad84 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.097042 Nov 09 05:00:42.482977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 405/822] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:42 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:42.610512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:42.611543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:42.618411 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:42.619495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:42.620287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:42.620720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:42.648238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f0ded55a-e2ea-4890-8131-635f785cae7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041729 Nov 09 05:00:42.648714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 418/823] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:43.494819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:43.495848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:43.502712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:43.503160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:43.503962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:43.504396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:43.625992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dacd6989-4758-423e-ab04-dfa25575813c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.135536 Nov 09 05:00:43.626632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 406/824] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:43 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:43.659552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:43.660513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:43.666878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:43.667327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:43.668214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:43.668681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:43.698586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6ab77df2-0ce2-4d69-abde-77488a27be79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Nov 09 05:00:43.699143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 419/825] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:44.637612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:44.638609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:44.645143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:44.645588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:44.646359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:44.646778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:44.709905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:44.710800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:44.717666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:44.718108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:44.718873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:44.719303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:44.746918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8f2a77c-ef11-4404-9e57-3a4fad869d3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Nov 09 05:00:44.747448 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 420/826] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:44.780251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6bc12710-e0ce-4cbe-b711-48369f3f3717 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.146818 Nov 09 05:00:44.781296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 407/827] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:44 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:45.758766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:45.759803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:45.766442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:45.766887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:45.767675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:45.768109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:45.792022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:45.793010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:45.797515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ec7f7657-726d-4c69-8fb9-968d17955de2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Nov 09 05:00:45.798072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 421/828] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:45.799736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:45.800175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:45.800939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:45.801366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:45.919305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3614e3a2-9911-4e2d-9983-c04a65370a02 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.131658 Nov 09 05:00:45.920569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 408/829] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:45 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:46.808485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:46.809399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:46.815604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:46.816090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:46.816866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:46.817304 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:46.848632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8413430b-003f-48ba-bb5a-078ab5775eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Nov 09 05:00:46.849198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 422/830] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:46.931221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:46.932297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:46.939783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:46.940230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:46.941004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:46.941434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:47.039641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-366a498a-6aae-40aa-8ad6-299bc5327cca tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.112281 Nov 09 05:00:47.040860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 409/831] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:46 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:47.861872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:47.862716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:47.868852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:47.869298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:47.870092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:47.870521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:47.898303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d2454fea-b757-41df-86b6-91c0dd91be09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Nov 09 05:00:47.898832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 423/832] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:48.052116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:48.053114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:48.060387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:48.060834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:48.061604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:48.062035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:48.147368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f69b476b-7838-4730-9568-429070a93009 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.099164 Nov 09 05:00:48.148042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 410/833] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:48 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:00:48.910489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:48.911391 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:48.918137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:48.918578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:48.919341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:48.919808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:48.947334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-514962c8-85f8-42a0-b756-367dd6d8b5f6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040687 Nov 09 05:00:48.947898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 424/834] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:49.159398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:49.160438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:49.167359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:49.167844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:49.168618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:49.169052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:49.958366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:49.959274 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:49.965549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:49.966001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:49.966772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:49.967208 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:49.996981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e326bed6-49a4-487d-9128-17174be0813e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042189 Nov 09 05:00:49.997529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 425/835] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:51.007788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:51.008702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:51.015472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:51.015960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:51.016734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:51.017171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:51.045385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1ff4ede3-1e14-42cd-a25a-3799a44d7194 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 Nov 09 05:00:51.045930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 426/836] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:52.056537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:52.057461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:52.063570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:52.064046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:52.064811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:52.065243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:52.093741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e6bc11cd-dd13-4382-b482-e66529d0554c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Nov 09 05:00:52.094270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 427/837] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:53.089153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-63d4bad2-db80-4144-8019-c58847294b7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 3.933599 Nov 09 05:00:53.089721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 411/838] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:49 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 3935 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:53.105366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:53.106298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:53.112553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:53.113004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:53.113789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:53.114224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:53.142845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b06170fb-42db-4ba3-b9fa-f47fd092ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041787 Nov 09 05:00:53.143392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 428/839] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:54.101099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:54.102027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:54.109474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:54.109908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:54.110672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:54.111097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:54.153812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:54.154718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:54.160876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:54.161322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:54.162093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:54.162529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:54.190918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-11a8f58e-6865-4fad-80b3-5a9a44fbcaee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041269 Nov 09 05:00:54.191462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 429/840] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:00:54.203264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-402c10f0-9246-4c32-91fe-35be2adef2c7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.106216 Nov 09 05:00:54.203946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 412/841] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:54 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:55.202052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:55.202953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:55.209100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:55.209546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:55.210323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:55.210757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:55.214677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:55.215689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:55.222402 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:55.222838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:55.223592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:55.224043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:55.240054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-27c235ea-0fe5-45ea-b1b1-8262cdae374d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Nov 09 05:00:55.240615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 430/842] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:55.358956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2867b0c7-19c5-4bd2-99c8-26e0969d9494 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.148100 Nov 09 05:00:55.359599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 413/843] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:55 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:56.251303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:56.252165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:56.258404 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:56.258849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:56.259638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:56.260718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:56.289902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5c42b53b-4f19-4575-bcac-8bc2a765b7a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 Nov 09 05:00:56.290462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 431/844] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:56.371824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:56.372998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:56.379846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:56.380287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:56.381041 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:56.381461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:56.472404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-769be444-a541-44f6-849f-1e430d346e8d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.105232 Nov 09 05:00:56.473063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 414/845] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:56 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:57.301216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:57.302159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:57.308427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:57.308877 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:57.309648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:57.310083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:57.339032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-41530d00-64cd-4092-a645-58ad8f2fd74d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040996 Nov 09 05:00:57.339566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 432/846] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:57.484316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:57.485264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:57.492019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:57.492469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:57.493241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:57.493674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:57.593185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f4389aac-0aca-4617-9f25-d164cb0d36d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.112704 Nov 09 05:00:57.593834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 415/847] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:57 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:58.350162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:58.351135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:58.357898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:58.358351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:58.359123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:58.359557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:58.387792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d2ee7bbc-a666-479c-adff-eb54b0daeea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Nov 09 05:00:58.388333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 433/848] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:58.605852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:58.606852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:58.613663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:58.614116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:58.614884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:58.615317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:58.698792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dbd8867f-5b9a-4dbc-bcd4-99960ce9b43a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.097298 Nov 09 05:00:58.699591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 416/849] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:58 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:00:59.398866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:00:59.399806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:59.406400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:59.406848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:59.407694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:59.408131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:59.436494 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-069c86f0-4d79-4558-bf71-433e780a1d7a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Nov 09 05:00:59.437019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 434/850] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:00:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:00:59.710695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:00:59.711708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:00:59.718434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:59.718871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:59.719650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:00:59.720075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:00:59.836244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4ec38def-777f-4f2a-84e5-0aca2373735f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.129328 Nov 09 05:00:59.836804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 417/851] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:00:59 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:00.448400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:00.449312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:00.455642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:00.456090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:00.456862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:00.457296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:00.485521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8bcf46a5-83b2-4e10-9289-dc1a0bfce802 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041441 Nov 09 05:01:00.486142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 435/852] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:00.848783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:00.849729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:00.861785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:00.862233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:00.863000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:00.863425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:00.949590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-69939bd1-7a18-4fe5-a1b2-44d96bcc36e6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.104763 Nov 09 05:01:00.950452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 418/853] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:00 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:01.497209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:01.498158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:01.503941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:01.504391 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:01.505167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:01.505606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:01.534072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-88d2f970-04bd-4677-add3-641515b121bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 Nov 09 05:01:01.534614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 436/854] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:01.961910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:01.962896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:01.970301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:01.970740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:01.971492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:01.971944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:02.056407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d6337a78-255c-4a7e-8edd-ec41e944d674 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.098342 Nov 09 05:01:02.057042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 419/855] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:01 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:02.546566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:02.547468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:02.554194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:02.554633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:02.555409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:02.555870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:02.585233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1889a33d-be75-456b-b7d4-3f51473bdf92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 Nov 09 05:01:02.585789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 437/856] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:03.068434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:03.069282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:03.076498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:03.076940 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:03.077707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:03.078130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:03.167340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8013d418-e3e8-4c37-ba12-3452e7bf5c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.102942 Nov 09 05:01:03.167982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 420/857] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:03 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:03.596405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:03.597316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:03.603532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:03.604010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:03.604790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:03.605230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:03.632941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-48ba2b18-e724-4512-afe4-f9e837de62d5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040321 Nov 09 05:01:03.633482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 438/858] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:04.179135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:04.180195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:04.186967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:04.187407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:04.188196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:04.188694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:04.281488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-30bad093-312e-486f-8bab-42a69a6aafe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 28636 microversion: 2.1 time: 0.106079 Nov 09 05:01:04.282063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 421/859] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:04 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 28636 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:04.644305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:04.645212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:04.651474 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:04.651962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:04.653000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:04.653436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:04.681261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4f26dafc-30a3-4182-886d-77ed73b65eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040714 Nov 09 05:01:04.682323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 439/860] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:05.293768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:05.294766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:05.301687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:05.302129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:05.302891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:05.303321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:05.398171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3fb8bdca-dc7e-44c8-ab6c-7771037f6eac tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 29749 microversion: 2.1 time: 0.108413 Nov 09 05:01:05.398782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 422/861] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:05 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 29749 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:05.693061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:05.693905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:05.700164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:05.700610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:05.701395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:05.701857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:05.729982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2a82da73-7dcc-494a-a853-b58c12d0ab9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040225 Nov 09 05:01:05.730526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 440/862] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:06.411368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:06.412403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:06.419237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:06.419712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:06.420480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:06.420914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:06.529704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dcb5f8b3-bad1-4f80-89fe-ca262d5fae99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 31811 microversion: 2.1 time: 0.122288 Nov 09 05:01:06.530304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 423/863] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:06 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 31811 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:06.741406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:06.742251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:06.748532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:06.748983 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:06.749756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:06.750196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:06.778886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d8f54fc2-64aa-46e9-b4bb-3a84cba6c681 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041282 Nov 09 05:01:06.779428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 441/864] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:07.542302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:07.543246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:07.550129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:07.550579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:07.551349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:07.551811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:07.645076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-579d8204-72b5-4654-9c37-61df7c28c91c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 33384 microversion: 2.1 time: 0.107234 Nov 09 05:01:07.645718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 424/865] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:07 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 33384 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:07.790114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:07.791018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:07.797977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:07.798379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:07.799162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:07.799601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:07.828283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-58f5e9d8-66bb-4afe-ab0d-bc87f7d8f54d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041891 Nov 09 05:01:07.828833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 442/866] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:08.657898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:08.659040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:08.665671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:08.666113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:08.667404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:08.667856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:08.760766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ebccb340-137a-4724-9afe-039b7ffaf3d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 34402 microversion: 2.1 time: 0.106687 Nov 09 05:01:08.761633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 425/867] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:08 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 34402 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:08.839753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:08.840599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:08.846920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:08.847367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:08.848168 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:08.848609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:08.878162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-055f8196-4500-4749-a52d-b74674b649ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Nov 09 05:01:08.878717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 443/868] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:09.772809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:09.773807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:09.781034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:09.781420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:09.782181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:09.782608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:09.882639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-572d58d0-f166-4d5b-a8e4-6c8105389099 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 35568 microversion: 2.1 time: 0.113787 Nov 09 05:01:09.883511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 426/869] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:09 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 35568 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:09.889417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:09.890320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:09.896512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:09.896953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:09.897716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:09.898143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:09.926230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c69d9d52-af8d-4aff-828b-ce527811dfa9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041206 Nov 09 05:01:09.926780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 444/870] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:10.894643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:10.895693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:10.902859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:10.903305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:10.904094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:10.904525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:10.938078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:10.938984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:10.945127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:10.945600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:10.946372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:10.946807 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:10.975940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1fdfcc5e-47a1-4d5a-b33d-f70df7a7a133 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Nov 09 05:01:10.976504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 445/871] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:01:11.001923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0027c0e4-bbed-4912-b880-8693b9473d7d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 36887 microversion: 2.1 time: 0.110981 Nov 09 05:01:11.002921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 427/872] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:10 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 36887 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:11.986689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:11.987606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:11.993811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:11.994259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:11.995032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:11.995467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:12.013891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:12.014975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:12.022572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:12.023014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:12.023823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:12.024255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:12.027781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-56bc6056-6e0b-4566-943b-8e8d9d6bb22d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Nov 09 05:01:12.028844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 446/873] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:12.165036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-965d111c-7e3d-4e17-b5f5-b3cab35d8139 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 38168 microversion: 2.1 time: 0.154953 Nov 09 05:01:12.165668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 428/874] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:12 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 38168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:01:13.039425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:13.040364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:13.046609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:13.047058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:13.047862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:13.048299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:13.077495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d822d37b-ddc8-4dfb-ad75-a92da9b1c2d4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 Nov 09 05:01:13.078061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 447/875] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:13.177030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:13.178022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:13.184852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:13.185299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:13.186062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:13.186488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:13.271998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7cc09181-f075-4de8-bf5b-bbdc2a7327f5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 38168 microversion: 2.1 time: 0.098684 Nov 09 05:01:13.272625 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 429/876] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:13 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 38168 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:01:14.088315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:14.089222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:14.095450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:14.095931 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:14.096705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:14.097140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:14.126586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d712affa-501c-4de6-9e77-4dc22b355454 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Nov 09 05:01:14.127141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 448/877] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:14.284254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:14.285284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:14.292770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:14.293217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:14.293988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:14.294419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:14.381401 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ac32710c-b68c-4ef9-8708-63264266d46e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 38168 microversion: 2.1 time: 0.101025 Nov 09 05:01:14.382037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 430/878] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:14 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 38168 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:15.138488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:15.139401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:15.145684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:15.146139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:15.146917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:15.147355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:15.175864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a60650f0-d568-4ec3-af8e-8507aa9ecea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041712 Nov 09 05:01:15.176432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 449/879] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:15.392902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:15.393913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:15.400647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:15.401086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:15.401856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:15.402543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:15.522326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0b5fc2e2-8496-4df1-b4fd-003d1c0fed8b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 38168 microversion: 2.1 time: 0.133240 Nov 09 05:01:15.522859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 431/880] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:15 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 38168 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:16.187181 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:16.188142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:16.194667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:16.195122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:16.195955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:16.196389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:16.226231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5d11730e-c913-46a3-89a8-b5b8cc5912b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Nov 09 05:01:16.226585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 450/881] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:16.534141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:16.535064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:16.542611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:16.543058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:16.543856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:16.544290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:16.644738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fe50892c-3340-4d0b-93c1-cc08b27bb395 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 38291 microversion: 2.1 time: 0.114488 Nov 09 05:01:16.645688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 432/882] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:16 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 38291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:17.238280 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:17.239197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:17.246024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:17.246479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:17.247263 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:17.247726 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:17.277801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b4425b0f-0039-482b-b3eb-0fcd62cc0d0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Nov 09 05:01:17.278358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 451/883] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:17.658201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:01:17.659195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:17.666221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:17.666687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:17.667447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:17.667901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:17.914938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b06bfb15-65e2-41a1-9ae7-c2be967583d9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action" status: 200 len: 38299 microversion: 2.1 time: 0.260615 Nov 09 05:01:17.915585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 433/884] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:01:17 2021] POST /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/action => generated 38299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:01:17.925164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:17.925655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:17.931540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:17.932032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:17.933321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:17.933780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:17.956792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a4f578e-3f93-4e75-8eb2-797a9f670411 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/ips" status: 200 len: 147 microversion: 2.1 time: 0.035299 Nov 09 05:01:17.957361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 452/885] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 9 05:01:17 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:18.289714 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:18.290718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:18.297982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:18.298439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:18.299214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:18.299667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:18.328858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cfee093b-81c3-486f-ac55-979b42ea8222 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Nov 09 05:01:18.329416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 434/886] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:19.340302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:19.341213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:19.347678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:19.348128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:19.349020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:19.349333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:19.378792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85ba8c50-1bc0-4ffb-8748-8c709938a993 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 Nov 09 05:01:19.379341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 453/887] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:20.389807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:20.390711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:20.396896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:20.397369 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:20.398135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:20.398558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:20.428762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-13027652-a98a-45e9-a061-1e2520c9c359 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Nov 09 05:01:20.429311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 435/888] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:21.440085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:21.441109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:21.447152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:21.447597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:21.448432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:21.448867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:21.477400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-64e011be-65ca-49ca-8ff1-756547bbd14f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 Nov 09 05:01:21.477943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 454/889] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:22.489045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:22.489952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:22.496671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:22.497114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:22.497883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:22.498310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:22.527533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5730aaaf-fde9-4f3f-b018-142f60b41b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Nov 09 05:01:22.528116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 436/890] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:23.538590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:23.539497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:23.546207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:23.546657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:23.547440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:23.547900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:23.580584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-be3545fe-f44e-4513-a8a3-c7329d5ea0e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Nov 09 05:01:23.581140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 455/891] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:24.591164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:24.592276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:24.598710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:24.599156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:24.599982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:24.600417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:24.630086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-75386e67-444f-4d1d-b210-58993191469d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Nov 09 05:01:24.630640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 437/892] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:25.642712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:25.643206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:25.649040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:25.649485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:25.650287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:25.650816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:25.680106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8ef96649-3b55-4c33-997f-639be584f947 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041902 Nov 09 05:01:25.680646 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 456/893] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:26.692116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:26.693160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:26.700742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:26.701121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:26.701970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:26.702407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:26.731344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cab473bb-4063-4a33-89da-786b720905aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Nov 09 05:01:26.731915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 438/894] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:27.742081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:27.743079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:27.749946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:27.750501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:27.751393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:27.751925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:27.782170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-297bd656-1d8d-42bb-9a25-e323c106e600 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Nov 09 05:01:27.782738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 457/895] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:28.793367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:28.794451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:28.801237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:28.801716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:28.802494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:28.802997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:28.834781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-081eefad-e71f-441d-8f74-ed9d022b9150 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Nov 09 05:01:28.835492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 439/896] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:29.847254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:29.848200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:29.855289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:29.856025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:29.857119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:29.857563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:29.887153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-609c571f-bb19-4bed-8195-5ba86a95e6a2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Nov 09 05:01:29.888120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 458/897] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:30.898159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:30.899094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:30.905502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:30.905951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:30.906827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:30.907144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:30.936267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-54a0b184-459d-4608-8179-14efa27c3d31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Nov 09 05:01:30.936821 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 440/898] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:31.544747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:01:31.544988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:01:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:01:31.947726 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:31.948596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:31.955066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:31.955513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:31.956324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:31.956759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:31.986727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7023345a-3ae8-423b-bc77-e50677f66da9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Nov 09 05:01:31.987283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 459/899] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:32.997804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:32.998710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:33.007225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:33.007721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:33.008491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:33.008920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:33.037728 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a50f69fa-62c7-4d57-8c0d-696f81fa85ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Nov 09 05:01:33.038278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 441/900] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:34.049147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:34.050169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:34.056201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:34.056644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:34.057416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:34.057846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:34.086927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c29d7d2d-4c25-4e91-a5c3-f14cf0637a74 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 Nov 09 05:01:34.087470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 460/901] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:34.285962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:01:34.286136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:01:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:01:35.097864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:35.098813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:35.105019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:35.106087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:35.106864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:35.107432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:35.135972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-89c8bc5d-473e-404e-9220-c7febb8b397f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041744 Nov 09 05:01:35.136524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 442/902] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:36.146142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:36.147051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:36.155058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:36.155504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:36.156298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:36.156802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:36.186322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-aff271bc-f624-4201-8f68-a732eef417f0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Nov 09 05:01:36.186875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 461/903] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:37.197501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:37.198500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:37.204823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:37.205271 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:37.206045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:37.206482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:37.235099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4a642165-2b07-430b-a323-18040634db84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041532 Nov 09 05:01:37.235661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 443/904] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:38.246590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:38.247499 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:38.253650 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:38.254041 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:38.254807 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:38.255235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:38.284894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7cddcd93-c263-4738-957f-bf99a7d74a87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042576 Nov 09 05:01:38.285436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 462/905] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:39.489301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:39.490288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:39.496044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:39.496487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:39.497247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:39.497675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:39.526262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4b893fa0-40c5-44e6-97b4-7c26e3814002 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233768 Nov 09 05:01:39.527652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 444/906] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:40.538194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:40.539029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:40.545801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:40.546241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:40.547001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:40.547429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:40.575713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1aaf5eb0-15b4-43af-ab66-295e839370ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Nov 09 05:01:40.576264 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 463/907] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:41.586250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:41.587210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:41.594071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:41.594515 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:41.595606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:41.596057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:41.625249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c2de2ad0-cdec-4251-908b-007c3c90b145 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Nov 09 05:01:41.625790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 445/908] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:42.636504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:42.637405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:42.643981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:42.644425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:42.645192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:42.645623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:42.674757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-18f650ac-6109-4f5d-a2c0-53ee0b6e24d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Nov 09 05:01:42.675298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 464/909] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:43.686066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:43.686970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:43.693267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:43.693717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:43.694485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:43.694918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:43.723299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-92e1134a-698c-4496-ab31-94483d66dba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 Nov 09 05:01:43.723873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 446/910] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:44.735088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:44.735948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:44.742114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:44.742573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:44.743370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:44.743819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:44.772083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0f36e17f-01dc-433d-83bc-5ddbb5f246b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Nov 09 05:01:44.772630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 465/911] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:45.784067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:45.784904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:45.791137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:45.791580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:45.792389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:45.792794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:45.821147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3c429aac-8922-4506-bf9d-0edabee6101c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 Nov 09 05:01:45.821693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 447/912] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:46.832613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:46.833470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:46.839761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:46.840206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:46.840999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:46.841433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:46.870405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d917df1f-ed91-4846-8530-5a00f9a2548e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041704 Nov 09 05:01:46.870947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 466/913] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:01:47.882239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:47.883156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:47.890054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:47.890504 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:47.891284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:47.891745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:47.919911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-759f9b2c-9ef6-4a4d-9e5e-94bf242cadc1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041381 Nov 09 05:01:47.920462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 448/914] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:48.931160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:48.932093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:48.938328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:48.938773 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:48.939539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:48.939999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:48.969189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b26a1522-5135-4ee7-bdb3-a2c924c784e0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041783 Nov 09 05:01:48.969755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 467/915] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:49.980592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:49.981574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:49.987880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:49.988327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:49.989099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:49.989531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:50.018025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-998df9e7-179c-438d-a81f-2d7aaf0640f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Nov 09 05:01:50.018574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 449/916] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:51.030703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:51.031614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:51.037939 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:51.038458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:51.039563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:51.040024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:51.075215 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ad76f283-3e9e-4fae-8e53-41bf289cf3a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 Nov 09 05:01:51.075815 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 468/917] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:52.088417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:52.089332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:52.095571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:52.096052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:52.096817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:52.097248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:52.126213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5985dacf-c14e-45ce-a140-0a98e5fc97d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041527 Nov 09 05:01:52.126779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 450/918] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:53.138238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:53.139143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:53.145322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:53.145764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:53.146528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:53.146955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:53.174952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-78322025-1fb2-4a6f-8019-cba8a2125a1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 Nov 09 05:01:53.175511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 469/919] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:54.186073 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:54.186989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:54.193379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:54.193826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:54.194601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:54.195039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:54.223918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8f912ad3-988c-4bbd-a558-22ebda41d77b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Nov 09 05:01:54.224468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 451/920] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:55.234864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:55.235788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:55.241935 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:55.242378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:55.243143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:55.243574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:55.271491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0d238232-4793-4a5d-a19c-da66d56a1ef0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040972 Nov 09 05:01:55.272053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 470/921] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:56.283233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:56.284088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:56.290316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:56.290760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:56.291524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:56.291991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:56.321319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d39d9c6d-fd0c-434c-85ee-ee76934e9d8e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Nov 09 05:01:56.321865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 452/922] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:57.332653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:57.333515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:57.339686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:57.340133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:57.340899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:57.341326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:57.369794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-538104aa-8afb-43ae-8178-ac21c801b17c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041024 Nov 09 05:01:57.370331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 471/923] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:58.381866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:58.382775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:58.390558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:58.390996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:58.391793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:58.392228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:58.420731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fd599343-2c4b-4724-abb8-f719fe758952 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042653 Nov 09 05:01:58.421277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 453/924] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:01:59.432085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:01:59.433029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:01:59.439403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:59.439884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:59.440662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:01:59.441095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:01:59.469659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f5f9cfe8-2cb4-4b6f-822b-11ba315e3f19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 Nov 09 05:01:59.470194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 472/925] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:01:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:00.481494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:00.482394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:00.488280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:00.488725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:00.489484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:00.489912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:00.517676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0d6d6dd-917c-487b-a1a3-e47eac60227f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040571 Nov 09 05:02:00.518151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 454/926] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:01.529823 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:01.530652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:01.536552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:01.536996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:01.537763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:01.538193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:01.566725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7e62fc97-dbfb-45fa-b1a7-c75270a9f69a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041518 Nov 09 05:02:01.567530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 473/927] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:02.578169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:02.579078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:02.585411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:02.585853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:02.586612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:02.587043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:02.616032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-388132fa-8428-49ec-9cc7-200e19f24472 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Nov 09 05:02:02.616510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 455/928] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:03.627767 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:03.628681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:03.634856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:03.635303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:03.636099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:03.636533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:03.664626 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-46049f3c-4310-49e5-85a5-0e7a89478417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040619 Nov 09 05:02:03.665165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 474/929] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:04.676131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:04.677028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:04.683172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:04.683613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:04.684408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:04.684839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:04.712783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9a3e1f2e-38b8-49e1-9848-9c92e1928060 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040418 Nov 09 05:02:04.713322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 456/930] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:05.724646 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:05.725572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:05.732378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:05.732819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:05.733583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:05.734011 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:05.761663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed3786c4-4777-4974-9eea-466b99b4cb06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 Nov 09 05:02:05.762418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 475/931] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:06.773534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:06.774936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:06.782801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:06.783612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:06.784902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:06.785336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:06.815417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fd2af9a3-d566-4c06-b059-1dc74b08160b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Nov 09 05:02:06.816008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 457/932] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:07.826824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:07.827662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:07.833848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:07.834286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:07.835056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:07.835485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:07.863966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-45586d67-83e3-49b1-b0b1-21535ba7bebd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Nov 09 05:02:07.864505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 476/933] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:08.874803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:08.875722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:08.881961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:08.882410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:08.883183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:08.883614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:08.911506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-578e360d-2c1d-4484-a554-be91fd8662f3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Nov 09 05:02:08.912084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 458/934] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:09.922746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:09.923686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:09.929851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:09.930296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:09.931090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:09.931524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:09.960426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8f4b3750-f261-464c-94e3-df20c598cf19 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Nov 09 05:02:09.960966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 477/935] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:10.972047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:10.972959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:10.979193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:10.979665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:10.980439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:10.980874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:11.009202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b3ff52cb-314b-487a-ab2d-a148a56bd7e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040901 Nov 09 05:02:11.009741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 459/936] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:12.019811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:12.020720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:12.027167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:12.027640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:12.028998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:12.029445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:12.057798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-acbd3b67-fe61-40bf-a110-edadc0a26f4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Nov 09 05:02:12.058347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 478/937] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:13.069064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:13.069970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:13.076324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:13.076723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:13.077497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:13.077946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:13.106074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-004034c9-e275-44d4-9f39-9073989b0548 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040787 Nov 09 05:02:13.107258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 460/938] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:14.118147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:14.118991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:14.125887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:14.126330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:14.127092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:14.127521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:14.155173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b49bbfa0-412b-414c-bdc0-96a8d4fb9816 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040814 Nov 09 05:02:14.155735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 479/939] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:15.166540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:15.167371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:15.173636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:15.174085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:15.174862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:15.175292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:15.204192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f42fa018-9a46-46e6-b0e5-9d98b83a6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Nov 09 05:02:15.204736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 461/940] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:16.216198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:16.217099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:16.223245 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:16.223714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:16.224482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:16.224907 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:16.253075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2c3d70b2-a755-4e2b-841b-e6f56c8311a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041177 Nov 09 05:02:16.253625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 480/941] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:17.264282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:17.265188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:17.271411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:17.271891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:17.272660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:17.273091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:17.302198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f455fb4-aec5-453e-ab40-8a5f5fa121a0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Nov 09 05:02:17.302745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 462/942] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:18.314257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:18.315081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:18.321285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:18.321732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:18.322498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:18.322933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:18.351033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2e75e3ff-a72c-4cf4-93d0-320bce745846 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040676 Nov 09 05:02:18.351572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 481/943] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:19.362430 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:19.363256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:19.369571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:19.370015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:19.370780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:19.371214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:19.399288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1a42ba75-bdcd-4dbd-a7ba-5ae3488c4515 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040707 Nov 09 05:02:19.399868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 463/944] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:20.410954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:20.411899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:20.418150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:20.418594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:20.419957 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:20.420393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:20.447975 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-130186e6-a3fe-4ade-b230-0560b9bd133d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Nov 09 05:02:20.448510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 482/945] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:21.459225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:21.460152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:21.466819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:21.467262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:21.468054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:21.468484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:21.497441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-28657fd3-88cd-4942-a221-61bc05b14646 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041999 Nov 09 05:02:21.498164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 464/946] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:22.508576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:22.509480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:22.515740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:22.516183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:22.516948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:22.517376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:22.545477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8be696f4-ef9a-413f-a3c2-179f1c7a5f94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040722 Nov 09 05:02:22.546013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 483/947] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:23.556282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:23.557190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:23.563399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:23.563880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:23.564656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:23.565092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:23.593637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-616b1b36-8229-479d-8fbe-6633f53618f7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Nov 09 05:02:23.594190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 465/948] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:24.605149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:24.606557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:24.612746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:24.613192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:24.613964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:24.614392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:24.642574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3d55d504-a0be-43fa-9d1d-8e8d963e0cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Nov 09 05:02:24.643115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 484/949] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:25.654820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:25.655780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:25.661967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:25.662411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:25.663170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:25.663604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:25.691680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5d485548-8a9c-4719-865a-269eef237ad6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041462 Nov 09 05:02:25.692227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 466/950] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:26.702701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:26.703597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:26.709873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:26.710315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:26.711076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:26.711504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:26.739081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-38a1a35b-ffba-4bcf-86be-546d1bf58e22 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040674 Nov 09 05:02:26.739641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 485/951] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:27.750774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:27.751703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:27.757930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:27.758375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:27.759140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:27.759570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:27.787328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b0fceb8b-4e53-48ed-a877-b8c3727ad9f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040903 Nov 09 05:02:27.787910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 467/952] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:28.798625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:28.799567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:28.805777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:28.806221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:28.807025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:28.807476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:28.836457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9019fb09-f07a-4bda-9a7d-6c164ea0157d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041627 Nov 09 05:02:28.837032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 486/953] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:29.847807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:29.848705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:29.854715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:29.855157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:29.855969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:29.856397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:29.884953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2bbe3f99-c245-49e6-a4dd-de9957909ec2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041023 Nov 09 05:02:29.885483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 468/954] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:30.896227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:30.897176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:30.904338 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:30.904792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:30.905567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:30.906004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:30.934446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5a98cdc3-862c-406b-ac96-f9f13e0b1c6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 Nov 09 05:02:30.934997 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 487/955] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:31.945751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:31.946717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:31.953590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:31.954031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:31.954827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:31.955254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:31.982875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4474f227-b291-47da-8e66-293f11024d7d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Nov 09 05:02:31.983415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 469/956] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:32.994156 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:32.995065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:33.001502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:33.001952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:33.002726 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:33.003166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:33.032265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2f8c1c3d-7fd9-4333-a337-f2da945b0ded tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Nov 09 05:02:33.032809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 488/957] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:34.043400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:34.044938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:34.051200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:34.051678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:34.052449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:34.052877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:34.080799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-982d9649-f5f4-4330-970b-2c40c493a19e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041159 Nov 09 05:02:34.081351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 470/958] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:35.092105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:35.093016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:35.099188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:35.099694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:35.100469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:35.100911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:35.129708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7101f8b8-e51e-4751-a71f-b5c7c127ff2f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Nov 09 05:02:35.130251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 489/959] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:36.141215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:36.142112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:36.148356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:36.148796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:36.149558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:36.149983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:36.180578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-78e69b14-7768-42eb-b7dd-8d92941a9687 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 Nov 09 05:02:36.181139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 471/960] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:37.191891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:37.192806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:37.199002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:37.199449 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:37.200251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:37.200693 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:37.229452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c3ce4eb6-cdf7-4fea-ab33-4f825105a6a6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Nov 09 05:02:37.229996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 490/961] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:38.241355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:38.242463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:38.249643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:38.250100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:38.250885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:38.251321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:38.289728 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d5f1fa40-8b2f-41d8-880e-68e921e8b660 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051927 Nov 09 05:02:38.290304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 472/962] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:39.301287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:39.302190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:39.308364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:39.308808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:39.309577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:39.310086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:39.338230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-51207093-9e9b-472c-858c-c5fa98f515e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040749 Nov 09 05:02:39.338783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 491/963] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:40.349979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:40.350881 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:40.357620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:40.358062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:40.358815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:40.359238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:40.387216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-af62196f-fd08-4074-83f5-677dfea4d8e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 Nov 09 05:02:40.387823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 473/964] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:41.398496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:41.399408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:41.406523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:41.407328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:41.408296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:41.408894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:41.439094 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1d3502d8-5ab8-4aa1-876a-98646ce41fa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Nov 09 05:02:41.439673 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 492/965] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:42.450753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:42.451709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:42.457974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:42.458417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:42.459184 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:42.459614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:42.488820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-84652c3c-aef3-4d34-be87-dff6fc4ce3fd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Nov 09 05:02:42.489549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 474/966] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:43.500860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:43.501760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:43.508035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:43.508478 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:43.509241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:43.509670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:43.537371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-88173097-68e3-4160-896b-eef27f5b4e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Nov 09 05:02:43.537903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 493/967] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:02:44.549115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:44.550013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:44.556265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:44.556704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:44.557466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:44.557892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:44.586336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9e52d289-f875-41bd-824a-c9187996133e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Nov 09 05:02:44.586967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 475/968] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:45.597831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:45.598735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:45.604939 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:45.605387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:45.606154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:45.606590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:45.634166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b756afc4-6d4f-4d8d-aa19-782a8c8878a5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040150 Nov 09 05:02:45.634707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 494/969] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:46.645891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:46.646823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:46.653808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:46.654252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:46.655028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:46.655482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:46.684260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4df1631f-384c-4524-ac00-3935348aa423 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042193 Nov 09 05:02:46.684817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 476/970] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:47.696719 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:47.697657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:47.704538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:47.704986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:47.705759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:47.706189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:47.733912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-618f6746-583c-4879-9ee9-0cd6d4079ce5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Nov 09 05:02:47.734446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 495/971] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:48.745102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:48.746010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:48.753180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:48.753654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:48.754424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:48.754855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:48.783569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-717cdf87-3327-441e-ac64-27f94335150e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 Nov 09 05:02:48.784513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 477/972] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:49.795322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:49.796251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:49.802401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:49.802843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:49.803601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:49.804062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:49.832188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-df94edc9-4c42-400f-8666-2d9c71362114 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040567 Nov 09 05:02:49.832668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 496/973] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:50.843931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:50.844799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:50.850983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:50.851437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:50.852240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:50.852674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:50.880846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9a888bdb-c905-406e-8587-74d589ff07b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041335 Nov 09 05:02:50.881390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 478/974] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:51.892710 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:51.893621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:51.900125 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:51.900574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:51.901345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:51.901779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:51.930096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ef2e4964-d511-4b03-87d7-f79372bbc513 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Nov 09 05:02:51.930644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 497/975] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:52.941471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:52.942385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:52.948645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:52.949090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:52.950370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:52.950800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:52.978935 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a2197da0-5c73-4b06-8735-6c1fdd1b78dc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Nov 09 05:02:52.979477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 479/976] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:53.990296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:53.991193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:53.997403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:53.997847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:53.998608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:53.999035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:54.026781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e4a88c9a-4d4d-4cdc-a21d-e38aece88005 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040358 Nov 09 05:02:54.027316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 498/977] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:55.038534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:55.040339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:55.046662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:55.047101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:55.047918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:55.048347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:55.076230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-898df88a-addd-43b5-b4c6-ccb0e2f9489b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040930 Nov 09 05:02:55.076766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 480/978] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:56.087350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:56.088289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:56.095329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:56.095827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:56.096600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:56.097029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:56.125323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-19efa8ee-beb1-48b1-92ac-8b26da6dddf8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 Nov 09 05:02:56.125861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 499/979] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:57.136545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:57.137442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:57.144544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:57.144994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:57.145773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:57.146209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:57.174851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-627cbac2-a453-47c2-ab27-290bf2958b6d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Nov 09 05:02:57.175395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 481/980] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:58.186285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:58.187262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:58.193490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:58.193940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:58.194730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:58.195174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:58.224475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7b2e7782-7bde-455c-a4ee-352be37a6fe4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Nov 09 05:02:58.225024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 500/981] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:02:59.236235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:02:59.237129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:02:59.243275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:59.243755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:59.244513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:02:59.244938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:02:59.272547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-551a452e-f6db-44df-90a7-1e92a3cb4f0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040683 Nov 09 05:02:59.273086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 482/982] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:02:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:00.284349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:00.285264 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:00.291503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:00.291980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:00.292751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:00.293180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:00.322740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9d0a38fd-e940-496e-a3fc-82815e10c368 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Nov 09 05:03:00.323308 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 501/983] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:01.334615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:01.335603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:01.341600 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:01.342042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:01.342798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:01.343221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:01.370786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2196f7b0-24c4-475f-a720-b5826bc654ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039989 Nov 09 05:03:01.371316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 483/984] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:02.382380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:02.383286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:02.389726 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:02.390175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:02.390943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:02.391380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:02.420363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d95c961f-0795-4e7d-b0e2-d55d7f3d1380 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Nov 09 05:03:02.420918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 502/985] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:03.431546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:03.432492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:03.438778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:03.439217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:03.440020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:03.440448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:03.469243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c9f94e9-c9b8-40a2-acb2-5eef33b1c909 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041478 Nov 09 05:03:03.469779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 484/986] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:03:04.480643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:04.481554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:04.487852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:04.488303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:04.489075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:04.489511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:04.518256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b9a4a29c-780f-444c-9414-66c81787237f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Nov 09 05:03:04.518796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 503/987] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:05.530331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:05.531270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:05.537527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:05.537977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:05.538753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:05.539189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:05.570113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bd85be3d-0421-4b60-9019-909f44d22023 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Nov 09 05:03:05.570885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 485/988] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:06.581603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:06.582552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:06.588786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:06.589243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:06.590020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:06.590976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:06.619561 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-66ff552d-e7fe-41ee-a0ea-6557a018bb98 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041763 Nov 09 05:03:06.620149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 504/989] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:07.631002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:07.631934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:07.638783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:07.639229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:07.640023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:07.640457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:07.669122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9d248f90-1584-45c4-97a0-44cc5c47936e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041477 Nov 09 05:03:07.669849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 486/990] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:08.680565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:08.681522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:08.687826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:08.688269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:08.689030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:08.689459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:08.718094 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e57963d1-9efe-48bb-b47c-769f09409436 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Nov 09 05:03:08.718641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 505/991] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:03:09.728387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:09.729325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:09.735538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:09.736016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:09.736782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:09.737250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:09.765956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6d63502a-45fe-4742-9158-edcb37677921 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041364 Nov 09 05:03:09.766511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 487/992] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:10.777605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:10.779099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:10.785370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:10.785826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:10.786593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:10.787024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:10.816219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dbcd6e98-594a-48b6-ac25-471e0d69c068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Nov 09 05:03:10.816771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 506/993] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:11.827603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:11.828646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:11.834797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:11.835238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:11.836021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:11.836448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:11.865467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ac468c45-3119-4b60-a78d-2613f606a182 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Nov 09 05:03:11.866006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 488/994] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:12.876809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:12.877715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:12.883931 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:12.884376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:12.885137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:12.885565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:12.914591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-236b442d-a29c-4c32-be99-f31051ad9b03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Nov 09 05:03:12.915123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 507/995] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:13.925565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:13.926467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:13.932695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:13.933133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:13.933890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:13.934315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:13.961761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2462dc55-3d56-43f4-b2f0-a00081c95eef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040025 Nov 09 05:03:13.962288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 489/996] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:14.973527 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:14.974433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:14.980680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:14.981126 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:14.981900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:14.982336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:15.010423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-50582f36-bda6-4cc1-97f0-a7a170faaaf9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040695 Nov 09 05:03:15.010968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 508/997] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:16.022348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:16.023255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:16.030236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:16.030683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:16.031446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:16.031910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:16.061315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-675755b3-5aee-4639-834d-ab193c29a135 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Nov 09 05:03:16.061861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 490/998] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:17.072493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:17.073410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:17.079663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:17.080118 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:17.080894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:17.081333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:17.109593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-214559fb-abda-4b90-8b81-045ee760c9b7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040865 Nov 09 05:03:17.110143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 509/999] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:18.120696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:18.122161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:18.128426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:18.128870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:18.129634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:18.130060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:18.158296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0a9181f7-0199-4e8d-a5d3-7504569b6bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 Nov 09 05:03:18.158828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 491/1000] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:18.338919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:03:18.339427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:03:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:03:19.169498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:19.170401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:19.176616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:19.177058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:19.177820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:19.178253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:19.207331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d3dfcd55-8b27-41e0-978f-078d81c29e4b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 Nov 09 05:03:19.207899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 510/1001] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:20.218305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:20.219212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:20.225434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:20.225878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:20.226648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:20.227084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:20.256079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0f34e09e-bd79-4c76-a0e9-ce6b05dac7eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Nov 09 05:03:20.256621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 492/1002] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:21.267344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:21.268277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:21.274648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:21.275087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:21.275875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:21.276306 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:21.305241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c2bab8b-cb74-41e0-ab73-ec46de09425f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Nov 09 05:03:21.305774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 511/1003] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:22.316533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:22.317468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:22.323932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:22.324867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:22.325628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:22.326052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:22.354122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8274a03b-575b-4a34-b5f1-37d70d757218 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041367 Nov 09 05:03:22.354689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 493/1004] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:23.365531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:23.366438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:23.373193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:23.373631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:23.374393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:23.374820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:23.403021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-70ee7532-e795-4f7c-af62-b57b598c6806 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 Nov 09 05:03:23.403564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 512/1005] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:03:24.413761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:24.414724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:24.420929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:24.421375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:24.422159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:24.422577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:24.451308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-78f09929-ea35-41fe-8341-cc22934b3703 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Nov 09 05:03:24.451866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 494/1006] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:25.462517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:25.463472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:25.470254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:25.470701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:25.471488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:25.471954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:25.501333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-470086e1-4184-4dec-8738-602e7facf392 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042615 Nov 09 05:03:25.501875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 513/1007] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:26.512323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:26.513233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:26.519420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:26.519892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:26.520660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:26.521102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:26.549613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7d837818-b5d9-4b10-8655-a4bfae45afb8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 Nov 09 05:03:26.550170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 495/1008] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:27.561496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:27.562397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:27.568721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:27.569506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:27.569943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:27.570372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:27.598881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-227dc20b-9b5e-4216-838a-cc959c2619e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Nov 09 05:03:27.599423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 514/1009] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:28.611822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:28.612758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:28.618931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:28.619367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:28.620156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:28.620580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:28.648391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7dea0fd6-e514-481c-82bf-fd58451544a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040858 Nov 09 05:03:28.649189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 496/1010] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:29.660428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:29.661322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:29.667431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:29.667903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:29.668665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:29.669123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:29.696727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cfd26167-6760-44cc-a6f8-c58b94bd4ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040043 Nov 09 05:03:29.697257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 515/1011] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:30.708071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:30.709035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:30.714801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:30.715240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:30.716035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:30.716469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:30.745013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2e6aceb6-17d7-4a89-a837-5f75fddbba23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Nov 09 05:03:30.745557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 497/1012] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:31.756425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:31.757339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:31.763166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:31.763614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:31.764421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:31.764853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:31.792928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-721d7592-20ad-4503-9e8d-c31d1a8232b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040413 Nov 09 05:03:31.793463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 516/1013] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:32.804628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:32.805582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:32.812343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:32.812783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:32.813535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:32.813960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:32.842117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-314eec68-a91a-44aa-96d5-9450ea5b20bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Nov 09 05:03:32.842697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 498/1014] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:33.854384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:33.855293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:33.862271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:33.862715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:33.863483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:33.863945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:33.892298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0916d94f-978e-4cb1-8047-01466ee81d82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Nov 09 05:03:33.892839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 517/1015] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:34.903788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:34.904693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:34.911059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:34.911501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:34.912313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:34.912746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:34.941991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9ca9fcc7-2afb-46af-aa31-af279a11f79f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041950 Nov 09 05:03:34.942540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 499/1016] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:35.953801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:35.954738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:35.961042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:35.961487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:35.962251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:35.962686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:35.990225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3a668ce0-ff71-4476-aca2-252b2bfe8e06 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 Nov 09 05:03:35.990759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 518/1017] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:37.001570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:37.002465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:37.009393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:37.009832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:37.010597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:37.011021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:37.039326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4f941db0-f5ae-4959-9203-b187e7a8a9d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Nov 09 05:03:37.039892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 500/1018] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:38.050241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:38.051139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:38.057452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:38.057900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:38.058672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:38.059107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:38.088113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ce837002-9a6b-4a5a-a004-d91631e38bb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Nov 09 05:03:38.088660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 519/1019] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:39.099258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:39.100239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:39.106351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:39.106791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:39.107578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:39.108618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:39.136199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2802329b-c375-4953-8467-dff02b53827c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 Nov 09 05:03:39.136745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 501/1020] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:03:40.147194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:40.148127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:40.154525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:40.154963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:40.155761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:40.156191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:40.184327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cb830339-5310-4a52-91fe-2f580ca63465 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Nov 09 05:03:40.184869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 520/1021] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:41.196150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:41.197055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:41.204850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:41.205294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:41.206061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:41.206488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:41.235262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f4d97bf1-bd2f-4a24-89b5-ea6ad8675244 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 Nov 09 05:03:41.235834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 502/1022] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:41.828196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:03:41.828668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:03:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:03:42.246965 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:42.247867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:42.254576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:42.255026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:42.255835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:42.256274 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:42.284990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4d1266b5-50dd-4b16-9762-578a658a45a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Nov 09 05:03:42.285538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 521/1023] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:43.297213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:43.298259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:43.304446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:43.304884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:43.305640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:43.306063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:43.335257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-243b1a37-703e-4877-9682-d833c02a5bdf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Nov 09 05:03:43.335838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 503/1024] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:44.346856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:44.347715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:44.353911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:44.354358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:44.355131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:44.355565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:44.383551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b8323473-92c1-4be2-a136-68803684620e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Nov 09 05:03:44.384117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 522/1025] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:45.394767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:45.395687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:45.402120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:45.402565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:45.403323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:45.403778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:45.431892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ec135cba-ddb0-4970-8855-4952c66bce3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040886 Nov 09 05:03:45.432431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 504/1026] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:46.442219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:46.443146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:46.449310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:46.449759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:46.450524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:46.450953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:46.479125 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3e8a72c8-b0c1-4558-8e66-f251a1fee13c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040682 Nov 09 05:03:46.479673 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 523/1027] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:47.490241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:47.491213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:47.497489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:47.497939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:47.498748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:47.499860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:47.527978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-006c9652-d7d9-4d4a-8f5b-c15dd1a7f2b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Nov 09 05:03:47.528534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 505/1028] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:48.538288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:48.539226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:48.545425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:48.545896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:48.546647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:48.547077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:48.576455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-64266da7-793c-47f5-ad09-bc5d1febc236 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041892 Nov 09 05:03:48.577644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 524/1029] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:49.588431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:49.589360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:49.596037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:49.596470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:49.597224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:49.597646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:49.625884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c21bfa39-a8b6-4e1b-bb1a-b3297cf054ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041200 Nov 09 05:03:49.626416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 506/1030] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:50.636593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:50.637498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:50.643978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:50.644455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:50.645228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:50.645664 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:50.674118 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9bbf392d-df33-4670-ad2a-ac939f7a4c04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041298 Nov 09 05:03:50.674663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 525/1031] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:03:51.685654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:51.687058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:51.693340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:51.693785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:51.694553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:51.694984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:51.723208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9313e43b-3e0b-48de-8375-0cdd43640488 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041522 Nov 09 05:03:51.723774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 507/1032] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:52.734945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:52.735887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:52.742052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:52.742500 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:52.743270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:52.743731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:52.771980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-234b6b35-36a8-4982-9756-a122c72076a1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041316 Nov 09 05:03:52.772523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 526/1033] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:53.783467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:53.784421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:53.790582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:53.791052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:53.791841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:53.792270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:53.820089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-442ba4e4-c4c8-44c2-addb-e9055f0acbde tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040369 Nov 09 05:03:53.820624 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 508/1034] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:54.831983 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:54.832794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:54.839009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:54.839458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:54.840258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:54.840682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:54.869076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f622cdbd-615c-4c6c-9c18-0fcb7f8a9e1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 Nov 09 05:03:54.869618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 527/1035] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:55.880469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:55.881370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:55.887649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:55.888103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:55.888862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:55.889828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:55.918121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4bcc33e3-43a4-490f-bf04-185818a77cbe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041494 Nov 09 05:03:55.918663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 509/1036] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:56.929396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:56.930315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:56.937125 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:56.937573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:56.938356 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:56.938792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:56.967605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c4e7cf18-576f-4e12-a615-2ca13906711f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Nov 09 05:03:56.968174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 528/1037] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:57.978977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:57.979907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:57.986386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:57.986841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:57.987613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:57.988070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:58.016726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-91b5a3ff-826a-45f4-916e-d3728941ac3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Nov 09 05:03:58.017270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 510/1038] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:03:59.028130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:03:59.029060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:03:59.035241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:59.035722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:59.036486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:03:59.036914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:03:59.064971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed59855e-eaba-473c-b47d-c0c319b60232 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Nov 09 05:03:59.065506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 529/1039] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:03:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:00.076222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:00.077125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:00.082930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:00.083371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:00.084163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:00.084588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:00.113469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c7acb143-06f4-4780-8cf9-cf8a7ca0c2cd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041001 Nov 09 05:04:00.114010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 511/1040] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:01.125239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:01.126137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:01.132282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:01.132721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:01.133479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:01.133988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:01.161900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d9a5c1b1-61d6-4cc7-a003-de87c08e8597 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040955 Nov 09 05:04:01.162431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 530/1041] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:02.173055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:02.173959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:02.180255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:02.180699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:02.181466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:02.181899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:02.211244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9f2a91d3-d095-4766-9f4b-471630ea11ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Nov 09 05:04:02.211820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 512/1042] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:03.222516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:03.223344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:03.229285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:03.229728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:03.230490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:03.230919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:03.259435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e47854d6-7a6b-4873-807e-aa95870b4851 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040766 Nov 09 05:04:03.260009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 531/1043] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:04.270737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:04.271660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:04.278198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:04.278640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:04.279425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:04.279880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:04.307802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-801cb283-73f4-4d21-afdf-3ea0ab8f11d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040831 Nov 09 05:04:04.308345 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 513/1044] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:05.319614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:05.320530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:05.326755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:05.327196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:05.327986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:05.328413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:05.356439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-599900eb-a61c-47ef-89cc-d7a1bde51ece tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040535 Nov 09 05:04:05.356995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 532/1045] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:06.368412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:06.369242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:06.376095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:06.376539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:06.377300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:06.377735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:06.406585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4512c85e-09b9-4ae1-9c34-057800f14d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 Nov 09 05:04:06.407133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 514/1046] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:07.418179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:07.419080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:07.425322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:07.425760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:07.426522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:07.426948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:07.455576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7906bec7-203d-4577-a115-cda574cc2ddf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041217 Nov 09 05:04:07.456136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 533/1047] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:08.466873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:08.467809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:08.473991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:08.474433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:08.475191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:08.475639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:08.504123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e8b3b2ad-1346-4b3a-b7ec-8bebe0cd7f43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041144 Nov 09 05:04:08.504657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 515/1048] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:09.515390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:09.516317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:09.522526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:09.523228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:09.524026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:09.524455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:09.553520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-91a65818-c43d-483c-bbf6-4d59bab3b835 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 Nov 09 05:04:09.554082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 534/1049] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:10.565867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:10.566776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:10.573102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:10.573541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:10.574306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:10.574762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:10.602970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-66b71119-3e04-4bfd-bb78-25d2652d7b47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040883 Nov 09 05:04:10.603508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 516/1050] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:04:11.614216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:11.615140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:11.621408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:11.621851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:11.622615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:11.623048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:11.651574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3ae312b5-b979-4e5b-b360-feac13c55fd5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Nov 09 05:04:11.652131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 535/1051] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:12.663436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:12.664361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:12.671211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:12.671670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:12.672432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:12.672861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:12.700488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-946a2785-4eec-4597-afe7-c0c337276a82 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040799 Nov 09 05:04:12.701054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 517/1052] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:13.711767 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:13.712682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:13.718886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:13.719333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:13.720137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:13.720578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:13.750244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d89007cc-662f-44fe-8575-0987553613b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Nov 09 05:04:13.750805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 536/1053] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:14.761538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:14.762451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:14.768745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:14.769190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:14.769956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:14.770388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:14.800169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-25950807-7fad-4edb-aec0-9e58bee12551 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Nov 09 05:04:14.800725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 518/1054] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:15.811281 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:15.812858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:15.819164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:15.819566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:15.820370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:15.820807 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:15.848629 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-efbb18dd-703a-4e97-8361-d41856b0eba4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Nov 09 05:04:15.849172 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 537/1055] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:16.859080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:16.859943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:16.866163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:16.866615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:16.867378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:16.867835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:16.896079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-943e095e-4e51-4cf1-80f9-aa8de7baa334 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040834 Nov 09 05:04:16.896624 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 519/1056] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:17.908060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:17.909000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:17.915156 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:17.915601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:17.916400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:17.916834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:17.945161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ff5c64f9-93cb-4e92-b3b3-103fd8fe1e6e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Nov 09 05:04:17.945698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 538/1057] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:18.957051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:18.958012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:18.964273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:18.964716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:18.965481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:18.965914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:18.995860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ea127cae-3558-4020-b3f2-1928e5f875a9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Nov 09 05:04:18.996420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 520/1058] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:20.008630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:20.009567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:20.015830 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:20.016277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:20.017053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:20.017485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:20.046074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0b283e0b-2f6e-4c2d-a97f-7e3e406229f9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Nov 09 05:04:20.047225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 539/1059] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:21.058099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:21.059037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:21.065556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:21.065992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:21.066749 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:21.067172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:21.095893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-02516499-c82e-41d6-96c7-e28f41b1bf35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Nov 09 05:04:21.096437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 521/1060] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:22.107133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:22.108066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:22.114829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:22.115277 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:22.116095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:22.116533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:22.145439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-13eb21bb-0b9e-4085-84a3-813a8e639f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Nov 09 05:04:22.145993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 540/1061] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:23.156958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:23.157889 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:23.164155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:23.164606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:23.165369 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:23.165804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:23.193890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6d730738-6ee2-44d4-9990-1eef85562cc6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040668 Nov 09 05:04:23.194426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 522/1062] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:24.204803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:24.205696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:24.211865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:24.212307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:24.213069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:24.213500 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:24.241571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c8358ea6-4031-4676-9b1f-55ff3a46fd16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041077 Nov 09 05:04:24.242122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 541/1063] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:25.253772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:25.254684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:25.261463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:25.261908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:25.262708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:25.263119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:25.292684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-503f88ae-afdf-450f-8538-de10afeca6cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Nov 09 05:04:25.293243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 523/1064] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:26.305036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:26.305949 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:26.312865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:26.313310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:26.314074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:26.314510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:26.342049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7425d920-e5b5-433a-a2df-48cfec7a50bc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 Nov 09 05:04:26.342526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 542/1065] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:27.353229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:27.354136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:27.360908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:27.361358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:27.362127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:27.362561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:27.391918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ff0f26e2-b17f-4d1f-9807-04eae68e4c37 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Nov 09 05:04:27.392472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 524/1066] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:28.403421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:28.404354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:28.410559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:28.410983 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:28.411791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:28.412225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:28.440189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-66244e7e-4b67-4aed-9a70-4cbb154e2a10 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040596 Nov 09 05:04:28.440723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 543/1067] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:04:29.451557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:29.452986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:29.458763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:29.459211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:29.460008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:29.460439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:29.488536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-859436aa-06ec-40ea-8f7d-e8bdc01e6221 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040936 Nov 09 05:04:29.489078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 525/1068] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:30.498842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:30.499775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:30.505936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:30.506381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:30.507172 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:30.507603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:30.539294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-edfe43a7-15ab-437f-8993-5cbd88429cac tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Nov 09 05:04:30.539867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 544/1069] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:31.550882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:31.551808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:31.557971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:31.558411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:31.559179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:31.559601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:31.589750 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-abb4d3bd-f266-4c5d-af5a-d949eb69c320 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Nov 09 05:04:31.590321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 526/1070] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:32.600761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:32.601668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:32.607518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:32.607991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:32.608754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:32.609183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:32.636729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-82b5b28a-4984-4584-8cd9-5c9fe61cf9e4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039900 Nov 09 05:04:32.637268 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 545/1071] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:04:33.648947 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:33.649854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:33.656951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:33.657579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:33.658416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:33.658851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:33.688238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f893339a-caa4-49ae-a52a-c9eb9040f5d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Nov 09 05:04:33.688793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 527/1072] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:34.699958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:34.700880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:34.707948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:34.708406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:34.709158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:34.709585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:34.738570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-616787c4-be6b-484f-b9be-8ed7734a6191 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Nov 09 05:04:34.739118 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 546/1073] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:35.749924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:35.751314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:35.757758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:35.758207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:35.759046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:35.759547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:35.788561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-33710055-b282-4b5d-89e7-b968580b0d2c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042456 Nov 09 05:04:35.789106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 528/1074] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:36.800366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:36.801300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:36.807456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:36.807924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:36.808683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:36.809110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:36.837320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4ae7a07e-51f4-47e4-8d20-bc68c09bde29 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Nov 09 05:04:36.837801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 547/1075] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:37.848595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:37.849424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:37.856282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:37.856788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:37.857558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:37.857991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:37.886074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-baf79388-8d4d-42b3-9d4f-3c889a592c92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Nov 09 05:04:37.886614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 529/1076] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:38.898090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:38.899004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:38.905893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:38.906335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:38.907110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:38.907554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:38.937073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1bd167c7-7c16-4830-9e28-49b822543f56 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Nov 09 05:04:38.937632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 548/1077] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:39.948679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:39.949607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:39.958047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:39.958866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:39.959763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:39.960201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:39.991335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ae717519-2c5c-4295-a645-a0c0174d15c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046492 Nov 09 05:04:39.991923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 530/1078] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:41.002783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:41.003717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:41.009917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:41.010361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:41.011129 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:41.011567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:41.040042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-103a40a8-f067-4126-834e-b2d546469cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 Nov 09 05:04:41.040581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 549/1079] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:42.051878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:42.052790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:42.059012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:42.059458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:42.060262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:42.060695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:42.089151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-19966c82-efdc-43c3-8196-cbfb779a4dec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040610 Nov 09 05:04:42.089274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 531/1080] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:43.100015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:43.100934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:43.107139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:43.107593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:43.108921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:43.109361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:43.138165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5c863ea2-eec7-4e95-991e-b29c1f2ad3b5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Nov 09 05:04:43.138732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 550/1081] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:44.149653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:44.150575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:44.156759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:44.157201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:44.157952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:44.158377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:44.185681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0f9df3db-8db6-4d09-aed3-823e8bf10592 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040047 Nov 09 05:04:44.186821 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 532/1082] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:45.197529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:45.198468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:45.204850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:45.205302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:45.206075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:45.206507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:45.234530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-69db823d-84ac-4a10-bac6-72e8c19f701e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Nov 09 05:04:45.235064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 551/1083] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:46.245519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:46.246432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:46.253217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:46.253667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:46.254434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:46.254865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:46.283950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-01687253-26b9-4d01-9bd5-50403c2d131c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042316 Nov 09 05:04:46.284504 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 533/1084] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:47.294763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:47.296197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:47.302584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:47.303029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:47.303825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:47.304370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:47.332547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-44472b2e-fc4d-4c35-b8a2-6eba5205467c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 Nov 09 05:04:47.333079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 552/1085] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:48.344909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:48.345785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:48.352062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:48.352505 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:48.353258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:48.353681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:48.381403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-80b34546-51e1-4162-9245-c80781495ea4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041005 Nov 09 05:04:48.381942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 534/1086] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:49.391891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:49.392808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:49.399300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:49.399787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:49.400566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:49.401003 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:49.429959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-591965a6-b2fc-4e29-95a4-45774e857d03 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Nov 09 05:04:49.430505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 553/1087] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:50.441796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:50.442708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:50.449000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:50.449440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:50.450194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:50.450619 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:50.478078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e70e7ec2-e525-4d1c-80df-2539a4fdb193 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040075 Nov 09 05:04:50.478603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 535/1088] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:51.489750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:51.490650 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:51.496827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:51.497266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:51.498026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:51.498453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:51.525987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0ee0f2f4-5713-4e20-825d-1f556427dd9f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039989 Nov 09 05:04:51.526514 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 554/1089] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:51.561883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:04:51.562367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:04:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:04:52.537660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:52.538594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:52.544821 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:52.545794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:52.546549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:52.546974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:52.577328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-266aeeef-3989-4948-8771-9629e4bcecdd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Nov 09 05:04:52.577893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 536/1090] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:53.588660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:53.589577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:53.596456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:53.596905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:53.597674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:53.598105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:53.625828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5148e95b-4c1e-4998-ac36-898e5f17ca25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040893 Nov 09 05:04:53.626378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 555/1091] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:04:54.303565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:04:54.303759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:04:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:04:54.637080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:54.637973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:54.644776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:54.645217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:54.645973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:54.646396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:54.674844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a10d2bf2-5475-424b-b83f-37f959bc4903 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041449 Nov 09 05:04:54.675397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 537/1092] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:55.687018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:55.687954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:55.694273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:55.694712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:55.695476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:55.695954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:55.723762 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-905b7690-b13d-4e4d-b729-e36bb1ff0e0b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 Nov 09 05:04:55.724301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 556/1093] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:56.734773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:56.735694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:56.741864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:56.742301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:56.743060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:56.743483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:56.771305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-419a03f5-927c-431d-8fb2-f2afb8c8937c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040895 Nov 09 05:04:56.772135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 538/1094] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:57.782216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:57.783119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:57.789386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:57.789833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:57.790599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:57.791030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:57.819910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-734b502c-8d99-4a16-998a-0da785bc19bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Nov 09 05:04:57.820378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 557/1095] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:04:58.831047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:58.831982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:58.838166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:58.838606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:58.839358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:58.839815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:58.867529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6fdb1806-a7ef-4b52-886a-d5ea821dc85f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040328 Nov 09 05:04:58.868093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 539/1096] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:04:59.879449 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:04:59.880380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:04:59.886627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:59.887075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:59.887877 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:04:59.888316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:04:59.917199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-55adf3a0-a026-4872-9400-0171c01ec8e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041545 Nov 09 05:04:59.917747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 558/1097] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:04:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:00.928682 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:00.929639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:00.935545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:00.936593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:00.937355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:00.937776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:00.965102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0fbe3271-eae9-4735-873f-a74c12e55453 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040207 Nov 09 05:05:00.965637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 540/1098] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:01.976036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:01.976937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:01.982769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:01.983210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:01.984587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:01.985017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:02.013722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-da24ebac-6c76-4fbd-9419-49c17bcac05f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Nov 09 05:05:02.014291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 559/1099] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:03.025367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:03.026272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:03.032476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:03.032928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:03.033695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:03.034126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:03.062573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c9c397b7-e39e-4661-a6de-ca84c54af770 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041282 Nov 09 05:05:03.063804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 541/1100] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:04.074411 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:04.075314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:04.081594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:04.082043 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:04.082813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:04.083245 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:04.112251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bc2a1197-e995-4362-9824-03150c73a2fc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Nov 09 05:05:04.112801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 560/1101] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:05.123689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:05.124631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:05.131347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:05.131831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:05.132602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:05.133034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:05.161431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c434a838-a4a1-49b7-a8ae-0f9b01495cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Nov 09 05:05:05.161968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 542/1102] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:06.171780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:06.172715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:06.178918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:06.179383 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:06.180163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:06.180600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:06.208638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d910fa87-4600-431c-a27c-4cfef5ef6e30 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040642 Nov 09 05:05:06.209179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 561/1103] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:07.220034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:07.220939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:07.227148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:07.227593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:07.228380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:07.228813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:07.257177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b1170aa8-2982-4f4f-a079-de8905053d3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040907 Nov 09 05:05:07.257724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 543/1104] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:08.268548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:08.269450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:08.275873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:08.276316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:08.277078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:08.277503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:08.305516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e3a648c3-9e45-4c71-b5c4-caf78e0b1be2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040736 Nov 09 05:05:08.306051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 562/1105] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:09.317437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:09.318337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:09.324605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:09.325051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:09.325808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:09.326236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:09.354378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fe149095-9426-4b4f-b077-0116ec0b980a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Nov 09 05:05:09.354915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 544/1106] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:10.366697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:10.367553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:10.373775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:10.374222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:10.374998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:10.375959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:10.404705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6962ede5-40bf-414f-b9ad-dc8d0e442ede tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041864 Nov 09 05:05:10.405250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 563/1107] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:11.416966 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:11.417868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:11.424553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:11.424999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:11.425755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:11.426179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:11.454981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-591dac43-f390-4596-9325-4921c1c78b78 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042057 Nov 09 05:05:11.455530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 545/1108] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:12.466294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:12.467202 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:12.473893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:12.474354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:12.475119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:12.475553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:12.503384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ded07836-4bd2-4702-9815-18ea437add47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040936 Nov 09 05:05:12.503950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 564/1109] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:13.514799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:13.515751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:13.522250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:13.522698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:13.523463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:13.523919 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:13.552251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fe014420-abc1-4380-9ab5-1f3d95220568 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Nov 09 05:05:13.552823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 546/1110] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:14.563698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:14.564617 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:14.570894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:14.571326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:14.572119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:14.572546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:14.601561 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-029eaac2-7ba3-4fde-8c85-58963f477944 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Nov 09 05:05:14.602099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 565/1111] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:15.613322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:15.614226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:15.620457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:15.620908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:15.621676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:15.622107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:15.652028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e759181a-629d-4434-841c-cc69ad55fd43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Nov 09 05:05:15.652570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 547/1112] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:16.663090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:16.664017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:16.670248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:16.670723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:16.671490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:16.671951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:16.701235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-109ca568-e1fb-4126-b473-a628f76b7f86 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Nov 09 05:05:16.701782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 566/1113] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:17.712451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:17.713355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:17.720071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:17.720513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:17.721273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:17.721699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:17.752047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f85e1376-fe2d-44da-a868-c463b24e7856 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Nov 09 05:05:17.752620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 548/1114] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:18.763312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:18.764263 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:18.771017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:18.771743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:18.772521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:18.772955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:18.801952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cb6a5b6b-96f5-4854-9e5f-7c3db253851b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042368 Nov 09 05:05:18.802500 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 567/1115] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:19.812999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:19.814441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:19.820790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:19.821176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:19.821946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:19.822377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:19.850848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-27e57965-3cf2-40dd-84ee-36de43064437 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Nov 09 05:05:19.851395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 549/1116] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:20.862832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:20.863719 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:20.869961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:20.870412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:20.871189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:20.871647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:20.900687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1ef63742-2108-424e-a452-1c5461e0b119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 Nov 09 05:05:20.901227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 568/1117] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:21.911127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:21.912069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:21.918315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:21.918761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:21.919528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:21.919988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:21.948674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c588cd4c-7f5a-4c97-969c-557c647fc98a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 Nov 09 05:05:21.949219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 550/1118] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:22.960071 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:22.960991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:22.967214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:22.967694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:22.968475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:22.968914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:22.997800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2c02a27a-9600-492d-84a6-07959baa2420 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041610 Nov 09 05:05:22.998348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 569/1119] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:24.009306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:24.010192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:24.016831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:24.016831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:24.018161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:24.018492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:24.047111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a670874d-cb8d-4353-9fd4-9400ebb9440a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041503 Nov 09 05:05:24.048275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 551/1120] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:25.058279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:25.059190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:25.066124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:25.066571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:25.067341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:25.067818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:25.095891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c35bc97c-636c-4287-9215-c4e1ea70fd3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Nov 09 05:05:25.096425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 570/1121] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:26.107303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:26.108260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:26.114613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:26.114880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:26.115651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:26.116083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:26.144602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3e77ccee-19c0-46c7-9c43-2e87120553cb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041033 Nov 09 05:05:26.145141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 552/1122] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:27.155508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:27.156467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:27.163352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:27.163848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:27.164621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:27.165056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:27.193501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6db26b1d-bed2-4dc5-8c7c-d02e51a3afbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041800 Nov 09 05:05:27.194075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 571/1123] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:28.204699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:28.205606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:28.212026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:28.212468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:28.213235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:28.213660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:28.242731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1565e23f-36b4-4002-88a8-4f4b137fe068 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Nov 09 05:05:28.243285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 553/1124] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:29.254522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:29.255419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:29.261597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:29.262037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:29.262804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:29.263230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:29.291714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-07a03137-f2c6-4a1d-877f-0e211c91655a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Nov 09 05:05:29.292562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 572/1125] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:30.303327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:30.304200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:30.310152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:30.310594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:30.311354 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:30.311813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:30.343799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b1cdb7b3-da78-4f49-854f-eb80b9e9989b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Nov 09 05:05:30.344965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 554/1126] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:31.355387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:31.356314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:31.363159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:31.363605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:31.364413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:31.364841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:31.402587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f6b95706-ba18-41fe-aab2-2296a9a1e1b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050669 Nov 09 05:05:31.403180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 573/1127] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:32.415262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:32.416201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:32.422457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:32.422893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:32.423687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:32.424138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:32.451647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-adf36c77-c2a7-40c0-90c2-21b9c7c75b3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040127 Nov 09 05:05:32.452202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 555/1128] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:33.464032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:33.464518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:33.470429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:33.470881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:33.471691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:33.472240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:33.500964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-abf40feb-1b0f-434e-b481-b9e461abb4eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040917 Nov 09 05:05:33.504606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 574/1129] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:34.511997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:34.512912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:34.519527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:34.520012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:34.521045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:34.521477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:34.551668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0f4046a-2932-4526-9d5d-b4a0bb27791e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042457 Nov 09 05:05:34.551668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 556/1130] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:35.561880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:35.562849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:35.571378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:35.571882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:35.572667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:35.573102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:35.603025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c00d0611-4f9f-4606-8841-eb483195fcb6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Nov 09 05:05:35.603583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 575/1131] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:36.614196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:36.615168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:36.621265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:36.621766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:36.622458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:36.622883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:36.653386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-09c4e4ea-3afb-4289-adca-2f0f8286b3de tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042805 Nov 09 05:05:36.654063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 557/1132] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:37.664013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:37.664919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:37.671163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:37.671605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:37.672400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:37.672832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:37.701571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-78900df2-573d-46bd-8546-31160e5b95e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Nov 09 05:05:37.702130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 576/1133] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:38.713123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:38.714019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:38.720596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:38.721038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:38.721805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:38.722287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:38.751206 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fa13b2e3-0f08-44ce-b3b0-dabef0cf6a6f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Nov 09 05:05:38.751789 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 558/1134] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:39.762051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:39.762985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:39.769062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:39.769504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:39.770276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:39.770970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:39.800167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a4d93f9f-0696-4f48-a19d-ea73e75984a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Nov 09 05:05:39.800657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 577/1135] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:40.811157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:40.812117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:40.819100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:40.819609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:40.820334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:40.820762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:40.850555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eabdfba8-8751-47a1-86a6-e9139c95d9d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Nov 09 05:05:40.851276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 559/1136] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:41.862687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:41.863955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:41.871535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:41.872020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:41.872798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:41.873229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:41.902675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-579277c1-8bd9-42ee-b397-f505224f9d2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Nov 09 05:05:41.906330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 578/1137] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:42.913582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:42.915068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:42.921017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:42.921459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:42.922908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:42.923341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:42.952697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e6ebb0c9-6478-49b2-9c5f-744774e0b938 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Nov 09 05:05:42.953070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 560/1138] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:43.963460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:43.964406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:43.970515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:43.970950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:43.971748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:43.972180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:44.000949 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ab147654-3e9f-43fc-845b-a9fde1b90a44 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040586 Nov 09 05:05:44.001676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 579/1139] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:45.012364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:45.013272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:45.020054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:45.020976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:45.021738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:45.022985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:45.058983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3a739a7f-20fd-489a-8521-8f53b907accd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050241 Nov 09 05:05:45.059759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 561/1140] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:46.070185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:46.071132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:46.077459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:46.077906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:46.078686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:46.079140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:46.108071 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7e9a3272-b11c-4c3e-a2d7-15ee49517a40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Nov 09 05:05:46.108633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 580/1141] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:47.120344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:47.121248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:47.128099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:47.128547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:47.129324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:47.129758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:47.159336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-57d86928-bd5d-41fc-a4ae-6f96333236d0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Nov 09 05:05:47.159920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 562/1142] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:48.169946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:48.170845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:48.176772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:48.177141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:48.177894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:48.178314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:48.207337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-706d71b4-1a11-407d-95fa-3c22e1410bbd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040878 Nov 09 05:05:48.209180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 581/1143] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:49.220193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:49.221086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:49.227428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:49.227900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:49.228658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:49.229084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:49.259313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c09b0b60-9155-400f-aa45-d50890a7ebcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Nov 09 05:05:49.259898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 563/1144] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:50.270089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:50.271273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:50.277483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:50.277937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:50.278774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:50.279213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:50.308365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e1a6ee9b-3cb3-4e88-99da-3f12ed208dc8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Nov 09 05:05:50.308964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 582/1145] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:51.319696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:51.320804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:51.327454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:51.327933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:51.329371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:51.329803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:51.360517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-604ec269-7c68-4ea5-8e29-f22706b5df3a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Nov 09 05:05:51.361307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 564/1146] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:52.371993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:05:52.372897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:52.379187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:52.379577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:52.380379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:52.380812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:52.409761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d5c6e735-b580-4962-8d2c-b234c741ea4e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Nov 09 05:05:52.410307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 583/1147] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:05:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:05:53.420254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:05:53.421164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:05:53.427968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:53.428413 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:53.429177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:05:53.429607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:05:53.529143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-94c762bd-fb3c-4c96-85d7-35c9990ad363 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action" status: 200 len: 73815 microversion: 2.1 time: 0.112391 Nov 09 05:05:53.530111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 565/1148] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:05:53 2021] POST /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16/action => generated 73815 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:06:03.076978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:03.077507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:03.083987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:03.084429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:03.085193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:03.085625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:03.209024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lazy-loading 'services' on Instance uuid fa39714e-2b95-4e72-83de-9acc03f82eb2 {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:06:03.275679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-150083c0-ab76-421e-a456-3622672e9f12 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2/os-volume_attachments/35b8c003-c5b9-43bc-b40f-db6d943de3e3" status: 202 len: 0 microversion: 2.1 time: 0.202259 Nov 09 05:06:03.276273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 584/1149] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 05:06:03 2021] DELETE /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2/os-volume_attachments/35b8c003-c5b9-43bc-b40f-db6d943de3e3 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:06:03.980535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:03.981104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:03.988376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:03.988811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:03.989569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:03.989994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:04.014467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:06:04.088973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5fb6d85a-da06-4ece-8518-389f76006a41 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 204 len: 0 microversion: 2.1 time: 0.112054 Nov 09 05:06:04.089752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 566/1150] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:06:03 2021] DELETE /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:06:04.099381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:04.100117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:04.106551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:04.107023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:04.107855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:04.108284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:04.239953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:04.247258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c1f72f14-2a91-4d17-a864-81b458202e79 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1514 microversion: 2.1 time: 0.152665 Nov 09 05:06:04.247850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 585/1151] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:06:04 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:06:05.264719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:05.265501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:05.272130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:05.272511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:05.273315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:05.273783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:05.521940 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:05.529431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eca853b1-3359-4ca4-9447-fac8997ed1f7 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 200 len: 1514 microversion: 2.1 time: 0.268755 Nov 09 05:06:05.530009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 567/1152] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:06:05 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:05.684684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-b6c699fc-e021-492c-9e25-58992e4387a1 req-bd6d1f56-dd2e-4225-a26a-6e867922ba75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ab8304-4bda-45a0-8fee-112678f052c1", "name": "network-vif-deleted", "tag": "f24686e9-c45d-4fef-aa52-368d9d4a68a7"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:05.686243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:06:05.686243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:06:05.693147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b6c699fc-e021-492c-9e25-58992e4387a1 req-bd6d1f56-dd2e-4225-a26a-6e867922ba75 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:05.693601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b6c699fc-e021-492c-9e25-58992e4387a1 req-bd6d1f56-dd2e-4225-a26a-6e867922ba75 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:05.705250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-b6c699fc-e021-492c-9e25-58992e4387a1 req-bd6d1f56-dd2e-4225-a26a-6e867922ba75 service nova] Creating event network-vif-deleted:f24686e9-c45d-4fef-aa52-368d9d4a68a7 for instance d9ab8304-4bda-45a0-8fee-112678f052c1 on hv-cinder-81713 Nov 09 05:06:05.710691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-b6c699fc-e021-492c-9e25-58992e4387a1 req-bd6d1f56-dd2e-4225-a26a-6e867922ba75 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094947 Nov 09 05:06:05.711537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 586/1153] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:06:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:06:06.546152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:06.546752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: d9ab8304-4bda-45a0-8fee-112678f052c1] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:06.553020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:06.553462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:06.554222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:06.554649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:06.569478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] HTTP exception thrown: Instance d9ab8304-4bda-45a0-8fee-112678f052c1 could not be found. Nov 09 05:06:06.570060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Returning 404 to user: Instance d9ab8304-4bda-45a0-8fee-112678f052c1 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:06:06.570877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-943e4ff8-5842-4cef-af7e-271c0e768522 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1" status: 404 len: 111 microversion: 2.1 time: 0.028417 Nov 09 05:06:06.571409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 568/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:06:06 2021] GET /compute/v2.1/servers/d9ab8304-4bda-45a0-8fee-112678f052c1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:06:26.126005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:26.126587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:26.132682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:26.133128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:26.133896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:26.134330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:26.158999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:06:26.229235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a0c381fd-1097-4231-9b59-06ac7c5f05a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "DELETE /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 204 len: 0 microversion: 2.20 time: 0.107883 Nov 09 05:06:26.229759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 587/1155] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 9 05:06:26 2021] DELETE /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 05:06:26.240737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:26.241334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:26.247496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:26.247969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:26.248724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:26.249156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:26.377910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:26.385448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:26.386928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:26.388755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76b3b7db-c470-4b9a-9421-a0eb075f85f1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1724 microversion: 2.20 time: 0.151618 Nov 09 05:06:26.389308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 569/1156] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:26 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:27.408591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:27.409286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:27.415395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:27.415886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:27.416678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:27.417111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:27.559808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:27.573159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:27.574685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:27.575902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-99598706-6c58-4c49-9e2a-2c88370300b5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1724 microversion: 2.20 time: 0.172077 Nov 09 05:06:27.580109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 588/1157] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:27 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:28.414957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-7d691616-fd04-4023-8f6e-c1bc0dd6ec79 req-7d3ed060-2545-4866-a6fc-96e1c3fdc642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e3bd9-12b1-44b8-b263-15cd6de07fcd", "name": "network-vif-deleted", "tag": "61b97e25-c60b-444c-aa5c-c81e5e096ded"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:28.416576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:06:28.416576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:06:28.424646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-7d691616-fd04-4023-8f6e-c1bc0dd6ec79 req-7d3ed060-2545-4866-a6fc-96e1c3fdc642 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:28.425549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-7d691616-fd04-4023-8f6e-c1bc0dd6ec79 req-7d3ed060-2545-4866-a6fc-96e1c3fdc642 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:28.438325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-7d691616-fd04-4023-8f6e-c1bc0dd6ec79 req-7d3ed060-2545-4866-a6fc-96e1c3fdc642 service nova] Creating event network-vif-deleted:61b97e25-c60b-444c-aa5c-c81e5e096ded for instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd on hv-cinder-81713 Nov 09 05:06:28.443483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-7d691616-fd04-4023-8f6e-c1bc0dd6ec79 req-7d3ed060-2545-4866-a6fc-96e1c3fdc642 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Nov 09 05:06:28.444113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 570/1158] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:06:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:06:28.594932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:28.596833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:28.604808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:28.605521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:28.606493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:28.606918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:28.648340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:28.648988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:28.649603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.objects.instance [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lazy-loading 'fault' on Instance uuid 034e3bd9-12b1-44b8-b263-15cd6de07fcd {{(pid=115445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:06:28.702229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:28.711550 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:28.714697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:28.714697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-43f8d6f9-bda5-4232-b3dd-30507dd5c246 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 200 len: 1371 microversion: 2.20 time: 0.123924 Nov 09 05:06:28.715085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 589/1159] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:28 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:29.734083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:29.736499 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:29.744385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:29.744649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:29.745541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:29.746041 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:29.760744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] HTTP exception thrown: Instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd could not be found. Nov 09 05:06:29.761445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Returning 404 to user: Instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:06:29.762365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-19778e19-0bf4-44cd-bcd9-d7cb2870fd04 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 404 len: 111 microversion: 2.20 time: 0.032834 Nov 09 05:06:29.763003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 571/1160] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:29 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 09 05:06:29.772110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d0f879a5-88f1-46ce-9c75-5aed862a4f4b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '.version_select at 0x7f30bff3b550>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:29.775450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0f879a5-88f1-46ce-9c75-5aed862a4f4b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [52055fc5-0bd5-41ab-b94b-9b603daa1eb1] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 05:06:30.791524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0f879a5-88f1-46ce-9c75-5aed862a4f4b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [52055fc5-0bd5-41ab-b94b-9b603daa1eb1] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 34966. Nov 09 05:06:30.810436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d0f879a5-88f1-46ce-9c75-5aed862a4f4b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235842644" status: 204 len: 0 microversion: 2.20 time: 1.042247 Nov 09 05:06:30.811000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 590/1161] 10.222.0.41 () {60 vars in 1258 bytes} [Tue Nov 9 05:06:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235842644 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 05:06:31.523041 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-804edbc4-d274-4237-81d9-961797bc9074 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'create', calling method: .version_select at 0x7f30cc7dea60>, body: {"keypair": {"name": "tempest-keypair-892777659"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:31.541106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-804edbc4-d274-4237-81d9-961797bc9074 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:06:31.544846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-804edbc4-d274-4237-81d9-961797bc9074 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for user 115a975a272c4ad9a5e93a38ee1c8180 and project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:06:31.756008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-804edbc4-d274-4237-81d9-961797bc9074 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:06:31.759516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-804edbc4-d274-4237-81d9-961797bc9074 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for user 115a975a272c4ad9a5e93a38ee1c8180 and project df921510edf34ac09f5be957837f5546. Resources: {'key_pairs'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:06:31.772091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-804edbc4-d274-4237-81d9-961797bc9074 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.253071 Nov 09 05:06:31.772675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 572/1162] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Nov 9 05:06:31 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 09 05:06:33.005650 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1820686763", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c60fd891-87b5-46cd-8c22-d608e60c1a68"}], "security_groups": [{"name": "tempest-securitygroup--1181779097"}], "key_name": "tempest-keypair-892777659", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:33.104240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] validate_networks() for [('c60fd891-87b5-46cd-8c22-d608e60c1a68', None, None, None, None, None)] {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:06:33.517077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:06:33.517707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:06:33.518495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:06:33.519454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:06:33.520129 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:06:33.529981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:33.530420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:33.531214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:33.531659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:33.549244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for project df921510edf34ac09f5be957837f5546. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:06:33.553121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Getting quotas for user 115a975a272c4ad9a5e93a38ee1c8180 and project df921510edf34ac09f5be957837f5546. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:06:33.563593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:06:33.565974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:06:33.612200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2f320cb8-4633-4d29-8a94-5086f8635cbf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.611647 Nov 09 05:06:33.612845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 591/1163] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Nov 9 05:06:32 2021] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 09 05:06:33.623026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f574bfa5-7813-486f-ab7f-8c88840cbce4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:33.623737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f574bfa5-7813-486f-ab7f-8c88840cbce4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:33.679296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f574bfa5-7813-486f-ab7f-8c88840cbce4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:33.686589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f574bfa5-7813-486f-ab7f-8c88840cbce4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:33.688103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f574bfa5-7813-486f-ab7f-8c88840cbce4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:33.689237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f574bfa5-7813-486f-ab7f-8c88840cbce4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1281 microversion: 2.20 time: 0.070443 Nov 09 05:06:33.689778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 573/1164] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:33 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 05:06:34.707249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:34.707890 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:34.713985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:34.714347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:34.715123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:34.715547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:34.781624 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:34.789840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:34.791403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:34.792634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cde7d8aa-859a-45cd-ac69-1e07164afddf tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1351 microversion: 2.20 time: 0.090200 Nov 09 05:06:34.793254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 592/1165] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:34 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:35.810219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:35.811735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:35.819035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:35.819480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:35.820488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:35.821186 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:36.015165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:36.023839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:36.025366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:36.026457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6eb2b799-24ab-434a-afb2-49c52fbb6121 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.220024 Nov 09 05:06:36.027005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 574/1166] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:35 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:36.096457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-9cc417df-d6f9-409b-8ea2-bdbcb5eec6bf req-b3016201-e114-4e6a-ae28-65084296dc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6308e5b8-e07c-479a-abf3-726c34bb3ab9", "tag": "7cc6de73-4344-46a6-af37-6e01f08a188d"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:36.098120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:06:36.098120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:06:36.109452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-9cc417df-d6f9-409b-8ea2-bdbcb5eec6bf req-b3016201-e114-4e6a-ae28-65084296dc0e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:36.109895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-9cc417df-d6f9-409b-8ea2-bdbcb5eec6bf req-b3016201-e114-4e6a-ae28-65084296dc0e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:36.123373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-9cc417df-d6f9-409b-8ea2-bdbcb5eec6bf req-b3016201-e114-4e6a-ae28-65084296dc0e service nova] Creating event network-changed:7cc6de73-4344-46a6-af37-6e01f08a188d for instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 on hv-cinder-81713 Nov 09 05:06:36.129453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-9cc417df-d6f9-409b-8ea2-bdbcb5eec6bf req-b3016201-e114-4e6a-ae28-65084296dc0e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037264 Nov 09 05:06:36.131160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 593/1167] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:06:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:06:37.044955 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:37.045579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:37.052232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:37.052945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:37.054160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:37.054377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:37.336551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:37.344225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:37.346294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:37.347382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a734cd24-0d64-4954-a125-060bc2d1ae63 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.306563 Nov 09 05:06:37.347972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 575/1168] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:37 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:38.366150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:38.366780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:38.373337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:38.373794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:38.374572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:38.375009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:38.506510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:38.514264 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:38.515809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:38.516904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6b6b3d7a-cd71-4919-8fc5-4909db66ef0b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.154923 Nov 09 05:06:38.517463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 594/1169] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:38 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:39.534605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:39.535203 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:39.541217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:39.541656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:39.542833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:39.542833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:39.722737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:39.730288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:39.732031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:39.733114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-082df68a-728d-449c-abb1-b3d1a1c4131b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.202681 Nov 09 05:06:39.733662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 576/1170] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:39 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:40.753597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:40.754177 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:40.760388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:40.760827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:40.761618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:40.762054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:40.889865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:40.897716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:40.899205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:40.900311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6ee2b0e8-a21f-4a1b-ab65-8eac11d609e0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.151600 Nov 09 05:06:40.900866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 595/1171] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:40 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:41.917857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:41.918449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:41.924684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:41.925123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:41.925873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:41.926298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:42.059069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:42.066864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:42.068389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:42.069474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fa882d32-9474-4455-8d3f-dec0717f4666 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.155304 Nov 09 05:06:42.070027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 577/1172] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:41 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:42.195845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-b6cea491-343a-4864-98c9-8e9d2e1838e8 req-2e3a854b-7051-4775-a0dc-0be9727ba3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6308e5b8-e07c-479a-abf3-726c34bb3ab9", "name": "network-vif-plugged", "status": "completed", "tag": "7cc6de73-4344-46a6-af37-6e01f08a188d"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:42.198114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:06:42.198114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:06:42.207213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b6cea491-343a-4864-98c9-8e9d2e1838e8 req-2e3a854b-7051-4775-a0dc-0be9727ba3e4 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:42.207879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b6cea491-343a-4864-98c9-8e9d2e1838e8 req-2e3a854b-7051-4775-a0dc-0be9727ba3e4 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:42.220444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-b6cea491-343a-4864-98c9-8e9d2e1838e8 req-2e3a854b-7051-4775-a0dc-0be9727ba3e4 service nova] Creating event network-vif-plugged:7cc6de73-4344-46a6-af37-6e01f08a188d for instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 on hv-cinder-81713 Nov 09 05:06:42.225932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-b6cea491-343a-4864-98c9-8e9d2e1838e8 req-2e3a854b-7051-4775-a0dc-0be9727ba3e4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095525 Nov 09 05:06:42.227048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 596/1173] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:06:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:06:43.087544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:43.088163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:43.094284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:43.095235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:43.096020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:43.096443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:43.224829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:43.232455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:43.233977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:43.235056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-64d321d4-9c53-4ebe-bd42-0db17aaa6b5b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1407 microversion: 2.20 time: 0.151208 Nov 09 05:06:43.236454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 578/1174] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:43 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:44.254502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:44.255231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:44.261512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:44.261960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:44.262740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:44.263167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:44.401994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:44.410387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:44.411908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:06:44.413039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a0d8a358-aa24-4543-a340-9dd4a405cc75 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1600 microversion: 2.20 time: 0.163379 Nov 09 05:06:44.413591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 597/1175] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:06:44 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:06:44.429942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:06:44.430428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:44.436648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:44.437092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:44.437872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:44.438303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:44.513979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e5825343-425d-4f5d-8150-5ef5a5efafea tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087602 Nov 09 05:06:44.514572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 579/1176] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Nov 9 05:06:44 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:06:45.551849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:45.553442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:45.554344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-7ce27e32-f6a2-4994-a61d-e37dd59ac6ed req-cfa6c77b-4513-47f0-a777-52ff885de7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6308e5b8-e07c-479a-abf3-726c34bb3ab9", "tag": "7cc6de73-4344-46a6-af37-6e01f08a188d"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:45.556092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:06:45.556092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:06:45.560630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:45.561073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:45.561889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:45.562319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:45.564616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-7ce27e32-f6a2-4994-a61d-e37dd59ac6ed req-cfa6c77b-4513-47f0-a777-52ff885de7ef service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:45.565158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-7ce27e32-f6a2-4994-a61d-e37dd59ac6ed req-cfa6c77b-4513-47f0-a777-52ff885de7ef service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:45.577314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-7ce27e32-f6a2-4994-a61d-e37dd59ac6ed req-cfa6c77b-4513-47f0-a777-52ff885de7ef service nova] Creating event network-changed:7cc6de73-4344-46a6-af37-6e01f08a188d for instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 on hv-cinder-81713 Nov 09 05:06:45.582537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-7ce27e32-f6a2-4994-a61d-e37dd59ac6ed req-cfa6c77b-4513-47f0-a777-52ff885de7ef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032026 Nov 09 05:06:45.583234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 580/1177] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:06:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:06:45.670288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-60618af7-5cf6-47ee-83e4-4ef49f758586 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.122846 Nov 09 05:06:45.670923 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 598/1178] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:45 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:46.682320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:46.683356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:46.689448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:46.689911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:46.690693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:46.691125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:46.774491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-58614689-cd80-47b8-bb65-3e8622320fbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.096378 Nov 09 05:06:46.777709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 581/1179] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:46 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:47.786409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:47.787334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:47.794063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:47.794505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:47.795276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:47.795762 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:47.885657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-06da8d1b-10e3-464c-bc5a-d7b5788f0d0d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.103839 Nov 09 05:06:47.886401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 599/1180] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:47 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:48.897584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:48.898572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:48.905460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:48.905899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:48.906651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:48.907752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:48.996503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-93f1d026-02d9-4a3d-a05c-9f38169f08ca tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.103049 Nov 09 05:06:48.997115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 582/1181] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:48 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:50.007116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:50.008209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:50.014853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:50.015292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:50.016077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:50.017169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:50.103969 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c1eda1b1-e06e-4112-9863-774bd55af3aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.100665 Nov 09 05:06:50.104630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 600/1182] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:50 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:51.116178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:51.117175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:51.124045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:51.124494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:51.125254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:51.125688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:51.207009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bee946d9-6f3c-47f7-ace3-da69f224cf3f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.094778 Nov 09 05:06:51.207643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 583/1183] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:51 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:52.218231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:52.219235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:52.226062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:52.226509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:52.227273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:52.227734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:52.308456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-951b1ec9-c7df-4f34-9d89-b7cd06af6173 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.094071 Nov 09 05:06:52.309219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 601/1184] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:52 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:53.319355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:53.320374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:53.327171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:53.327607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:53.328374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:53.329308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:53.414649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-779e411e-ba98-4480-aa69-2f878c7e59f8 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.099010 Nov 09 05:06:53.415236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 584/1185] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:53 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:54.426779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:54.427709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:54.434433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:54.434872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:54.435655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:54.436088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:54.519510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e99c3cf3-9e36-4d18-9af2-2c6c990efc0e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.097122 Nov 09 05:06:54.520163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 602/1186] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:54 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:55.530455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:55.531441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:55.538734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:55.539170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:55.539960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:55.540388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:55.624761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0028f511-a3b5-4bd2-800e-3853992e53cb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 14 microversion: 2.20 time: 0.098143 Nov 09 05:06:55.625574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 585/1187] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:55 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:06:56.635880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:56.636881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:56.643902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:56.644347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:56.645115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:56.645549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:56.739177 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ac119fde-ede6-4b61-b961-c302950111be tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 10893 microversion: 2.20 time: 0.107269 Nov 09 05:06:56.739824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 603/1188] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:56 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 10893 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:06:57.751731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:57.752710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:57.759424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:57.759886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:57.760638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:57.761061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:57.854752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6dc7adca-79a1-4721-a456-a7a61117543e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 18083 microversion: 2.20 time: 0.107861 Nov 09 05:06:57.855305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 586/1189] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:57 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 18083 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:06:58.866597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:58.867519 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:58.874409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:58.874852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:58.876155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:58.876590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:58.968010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-87ba0287-3fc8-4ed2-a692-9cb752b7ebad tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 19133 microversion: 2.20 time: 0.105428 Nov 09 05:06:58.968837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 604/1190] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:58 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 19133 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:06:59.978755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:06:59.979697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:06:59.987051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:59.987484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:06:59.988276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:06:59.988707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:00.083720 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fedd05c8-05fb-4e51-84b9-bff4afedeb3d tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 21790 microversion: 2.20 time: 0.108777 Nov 09 05:07:00.084549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 587/1191] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:06:59 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 21790 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:01.094833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:01.095795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:01.102639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:01.103089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:01.103889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:01.104325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:01.192633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5fe3728d-53e2-472a-b61f-5465ee3658bb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 23235 microversion: 2.20 time: 0.101724 Nov 09 05:07:01.196964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 605/1192] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:01 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 23235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:02.205465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:02.206456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:02.213544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:02.213979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:02.214743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:02.215174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:02.308802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c5d87334-ed24-4695-a354-b30de60b96a7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 24548 microversion: 2.20 time: 0.107660 Nov 09 05:07:02.309433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 588/1193] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:02 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 24548 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:03.321336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:03.322384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:03.329190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:03.329642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:03.331058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:03.331495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:03.432936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2af37297-e9b4-46bf-b951-0315b86712fe tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 26246 microversion: 2.20 time: 0.115491 Nov 09 05:07:03.433819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 606/1194] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:03 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 26246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:04.445505 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:04.446425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:04.453255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:04.453694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:04.454449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:04.454879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:04.556488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b771205c-8c65-482e-bdd6-94ae47a22ac1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 27517 microversion: 2.20 time: 0.114872 Nov 09 05:07:04.557116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 589/1195] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:04 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 27517 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:05.569029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:05.570102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:05.576813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:05.577254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:05.578021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:05.578447 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:05.682052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7889945c-82c2-4122-97f7-12219d48594e tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 27888 microversion: 2.20 time: 0.117519 Nov 09 05:07:05.682697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 607/1196] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:05 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 27888 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:06.693729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:06.694714 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:06.701371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:06.701808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:06.702565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:06.702988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:06.795636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-085569cf-d4c7-43d3-881d-12392d3176fb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.105786 Nov 09 05:07:06.796368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 590/1197] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:06 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:07.808029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:07.809029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:07.815831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:07.816279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:07.817047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:07.817476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:07.906420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-39557dcc-accb-4cc5-b88b-7c3d716ea6a9 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.102272 Nov 09 05:07:07.907056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 608/1198] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:07 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:08.920063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:08.921383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:08.928729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:08.929174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:08.929937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:08.930367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:09.036014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-45b6e9ed-0912-48f3-a17a-590a36a0cbf0 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.121243 Nov 09 05:07:09.036561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 591/1199] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:08 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:10.047936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:10.048976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:10.055881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:10.056325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:10.057109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:10.057542 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:10.157479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-71a8256b-d6a2-41c8-8c58-73249d399f19 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.113536 Nov 09 05:07:10.158103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 609/1200] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:10 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:11.169511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:11.170497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:11.177711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:11.178148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:11.178896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:11.179316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:11.271121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c3433f39-6ddc-44e8-bb8c-fe409914c754 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.105441 Nov 09 05:07:11.271829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 592/1201] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:11 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:12.283354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:12.284888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:12.291803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:12.292255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:12.293030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:12.293468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:12.531447 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ebf02985-a284-4c3d-8c04-8c55ca5e2962 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.251972 Nov 09 05:07:12.532024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 610/1202] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:12 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:13.543809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:13.544796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:13.551538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:13.552010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:13.552779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:13.553207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:13.636576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e776d437-401d-4e9e-af43-c67611e6f345 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.096660 Nov 09 05:07:13.637197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 593/1203] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:13 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:14.648618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:14.649613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:14.656510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:14.656902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:14.657674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:14.658103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:14.747685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-beaa5b0f-640a-4f6d-bdd2-32c434589b59 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.102846 Nov 09 05:07:14.748565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 611/1204] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:14 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:15.760376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:15.761288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:15.768273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:15.768726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:15.769506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:15.769935 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:15.852855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7c74c001-9452-4a65-8b2a-a8617697b7d1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.096622 Nov 09 05:07:15.856693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 594/1205] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:15 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:16.864952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:16.865892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:16.872686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:16.873126 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:16.873907 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:16.874334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:16.958577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-da31bac0-918c-45f1-88eb-58884a04b617 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.097542 Nov 09 05:07:16.962420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 612/1206] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:16 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:17.970660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:17.972270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:17.979391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:17.979863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:17.980635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:17.981058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:18.068043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c1e7f7d9-d1db-4c57-9fc9-2aadf8c56cbb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28186 microversion: 2.20 time: 0.101405 Nov 09 05:07:18.068662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 595/1207] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:17 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28186 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:19.079772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:19.080833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:19.087565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:19.088045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:19.088819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:19.089252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:19.186764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2fa272c9-5ae3-490b-acef-ce7de100b71f tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28348 microversion: 2.20 time: 0.110868 Nov 09 05:07:19.187676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 613/1208] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:19 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28348 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:19.276613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:19.277180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:19.284412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:19.284855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:19.285606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:19.286032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:19.310528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:07:19.383128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-749b1ec9-6554-435c-ac48-2a0aa69d327a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 204 len: 0 microversion: 2.1 time: 0.110285 Nov 09 05:07:19.383791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 596/1209] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:07:19 2021] DELETE /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:07:19.394368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:19.395052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:19.401819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:19.402260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:19.403024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:19.403467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:19.529214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:19.537400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-915b9c31-c918-4f50-8e40-270a0e62d63c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1675 microversion: 2.1 time: 0.148582 Nov 09 05:07:19.537944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 614/1210] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:19 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:20.198771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:20.199816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:20.206460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:20.206908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:20.207730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:20.208162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:20.315867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3717adba-5a2c-4fbd-a663-f440c2fb68a6 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28477 microversion: 2.20 time: 0.120981 Nov 09 05:07:20.316496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 597/1211] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:20 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28477 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:20.554868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:20.555473 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:20.561910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:20.562357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:20.563142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:20.563604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:20.841461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:20.849568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4ca9ed49-a395-4667-b7d4-6d4fcaf2f588 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1675 microversion: 2.1 time: 0.298492 Nov 09 05:07:20.850350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 615/1212] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:20 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:21.328224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:21.329402 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:21.336883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:21.337324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:21.338090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:21.338546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:21.432450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9c84e236-5d97-4647-b20f-749dedc1e5e7 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.108346 Nov 09 05:07:21.436471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 598/1213] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:21 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:21.688477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-596eb479-c53d-41dd-b4a9-351ce7390175 req-d570be84-801d-4379-8346-2abdef5a8410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3364cb-1695-4329-82ff-d4e26da28b73", "name": "network-vif-deleted", "tag": "1a56d5b6-a073-45bb-a202-4b929f0d7b30"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:21.690258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:07:21.690258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:07:21.698002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-596eb479-c53d-41dd-b4a9-351ce7390175 req-d570be84-801d-4379-8346-2abdef5a8410 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:21.698518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-596eb479-c53d-41dd-b4a9-351ce7390175 req-d570be84-801d-4379-8346-2abdef5a8410 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:21.714452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-596eb479-c53d-41dd-b4a9-351ce7390175 req-d570be84-801d-4379-8346-2abdef5a8410 service nova] Creating event network-vif-deleted:1a56d5b6-a073-45bb-a202-4b929f0d7b30 for instance 3a3364cb-1695-4329-82ff-d4e26da28b73 on hv-cinder-81713 Nov 09 05:07:21.719570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-596eb479-c53d-41dd-b4a9-351ce7390175 req-d570be84-801d-4379-8346-2abdef5a8410 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099038 Nov 09 05:07:21.722097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 616/1214] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:07:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:07:21.869022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:21.869744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:21.876317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:21.877321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:21.878122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:21.878543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:21.908983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:21.909421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:21.909854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lazy-loading 'fault' on Instance uuid 3a3364cb-1695-4329-82ff-d4e26da28b73 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:07:21.949925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:21.957236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8513f0a3-a193-481a-861f-fbdab3cfe7aa tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 200 len: 1327 microversion: 2.1 time: 0.093824 Nov 09 05:07:21.957798 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 599/1215] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:21 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:22.445285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:22.446275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:22.452409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:22.452855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:22.453623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:22.454050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:22.552579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b80c4b85-0293-4d1b-918f-9c53cb5c06aa tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.111050 Nov 09 05:07:22.553502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 617/1216] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:22 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:22.973856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:22.974368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:22.980668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:22.981107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:22.981859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:22.982283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:22.994949 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] HTTP exception thrown: Instance 3a3364cb-1695-4329-82ff-d4e26da28b73 could not be found. Nov 09 05:07:22.995518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Returning 404 to user: Instance 3a3364cb-1695-4329-82ff-d4e26da28b73 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:07:22.996349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ec4a13a4-a9f7-4682-8cdb-787787d1c879 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 404 len: 111 microversion: 2.1 time: 0.026247 Nov 09 05:07:22.996878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 600/1217] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:22 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:07:23.005935 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2261a9f0-c1ed-4afc-9220-cb4a2995ad20 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '.version_select at 0x7f30bfe82ee0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:23.023018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2261a9f0-c1ed-4afc-9220-cb4a2995ad20 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457445519" status: 202 len: 0 microversion: 2.1 time: 0.021531 Nov 09 05:07:23.023559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 618/1218] 10.222.0.41 () {58 vars in 1217 bytes} [Tue Nov 9 05:07:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457445519 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:23.564667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:23.565676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:23.571998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:23.572445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:23.573218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:23.573651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:23.685084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c964a0c6-0f12-48f8-b038-8aa6d6eeebba tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.124117 Nov 09 05:07:23.685729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 601/1219] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:23 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:23.727388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-321b84f0-4241-44e0-96ec-bf3440230043 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'create', calling method: .version_select at 0x7f30bfeaec10>, body: {"keypair": {"name": "tempest-keypair-2025947826"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:23.743305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-321b84f0-4241-44e0-96ec-bf3440230043 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:07:23.747047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-321b84f0-4241-44e0-96ec-bf3440230043 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for user 07d92b2e7b1b46f6916c335b25a44ecf and project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:07:23.819015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-321b84f0-4241-44e0-96ec-bf3440230043 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:07:23.822602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-321b84f0-4241-44e0-96ec-bf3440230043 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for user 07d92b2e7b1b46f6916c335b25a44ecf and project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:07:23.837823 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-321b84f0-4241-44e0-96ec-bf3440230043 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.114278 Nov 09 05:07:23.838724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 619/1220] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 9 05:07:23 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:24.697429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:24.698456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:24.705724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:24.706211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:24.706997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:24.707693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:24.795394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-31d251bc-2dcd-4b5e-8e72-0826198c8c92 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.101892 Nov 09 05:07:24.796334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 602/1221] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:24 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:25.029887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-570658492", "imageRef": "ab5b902d-e5e4-40db-95e6-be2485552058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f10e939-279a-4c85-98c6-1d5ee6c0218c"}], "security_groups": [{"name": "tempest-securitygroup--1137092324"}], "key_name": "tempest-keypair-2025947826", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:25.127824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] validate_networks() for [('9f10e939-279a-4c85-98c6-1d5ee6c0218c', None, None, None, None, None)] {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:07:25.485808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:07:25.486684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:07:25.487153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:07:25.487585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:07:25.488012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:07:25.496453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:25.496902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:25.497704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:25.498138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:25.514942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:07:25.519225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Getting quotas for user 07d92b2e7b1b46f6916c335b25a44ecf and project acf465ea6c244dcaa76ca3817fc6801f. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:07:25.532943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:07:25.536545 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab5b902d-e5e4-40db-95e6-be2485552058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:07:25.585314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8171d28-22ec-4781-a125-2d2c0d7a4ebb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.559878 Nov 09 05:07:25.585951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 620/1222] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 05:07:25 2021] POST /compute/v2.1/servers => generated 402 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 05:07:25.596434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-04927c0d-74ed-4a05-a241-c87c6f93331d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:25.597204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-04927c0d-74ed-4a05-a241-c87c6f93331d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:25.650534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-04927c0d-74ed-4a05-a241-c87c6f93331d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:25.656925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-04927c0d-74ed-4a05-a241-c87c6f93331d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1237 microversion: 2.1 time: 0.064625 Nov 09 05:07:25.657484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 603/1223] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:25 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:25.806929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:25.808358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:25.815063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:25.815492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:25.816312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:25.816777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:25.904735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85457b51-6e81-4f97-b4ae-2bd9c9264338 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.101530 Nov 09 05:07:25.905398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 621/1224] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:25 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:26.673165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:26.673743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:26.680354 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:26.680797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:26.681568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:26.682000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:26.746224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:26.754155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9dec68d5-3205-476c-bebf-0815f67a5d43 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1295 microversion: 2.1 time: 0.084710 Nov 09 05:07:26.754739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 604/1225] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:26 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:26.917763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:26.918787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:26.926097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:26.926538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:26.927301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:26.927754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:27.016565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-04786b01-b199-4f8c-85de-b402f64d3284 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.102818 Nov 09 05:07:27.017504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 622/1226] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:26 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:27.771550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:27.772180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:27.778814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:27.779463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:27.780413 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:27.781067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:27.926898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:27.934767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-996d264d-3b0c-44dc-90f0-153cd3e16de5 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.167838 Nov 09 05:07:27.935343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 605/1227] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:27 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:27.971286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-8651aece-a1a8-4811-9745-8b4a59efd865 req-6276a500-09f9-41ee-85c9-70462587d079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4805f839-96d2-42b9-8e81-1ebd537fdc33", "tag": "508ee994-7191-4353-818e-c88d4f711451"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:27.974350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:07:27.974350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:07:27.983362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-8651aece-a1a8-4811-9745-8b4a59efd865 req-6276a500-09f9-41ee-85c9-70462587d079 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:27.983888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-8651aece-a1a8-4811-9745-8b4a59efd865 req-6276a500-09f9-41ee-85c9-70462587d079 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:28.001735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-8651aece-a1a8-4811-9745-8b4a59efd865 req-6276a500-09f9-41ee-85c9-70462587d079 service nova] Creating event network-changed:508ee994-7191-4353-818e-c88d4f711451 for instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 on hv-cinder-81713 Nov 09 05:07:28.007135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-8651aece-a1a8-4811-9745-8b4a59efd865 req-6276a500-09f9-41ee-85c9-70462587d079 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040019 Nov 09 05:07:28.007712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 623/1228] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:07:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:07:28.028902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:28.029853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:28.036608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:28.037048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:28.037819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:28.038425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:28.136467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76f5f0bb-246d-4454-ac8f-aaeb5664b9b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.106229 Nov 09 05:07:28.136467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 606/1229] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:28 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:28.952958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:28.953642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:28.959476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:28.959950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:28.960728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:28.961159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:29.095084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:29.102865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-21d65a43-dd48-441c-b3f9-2b32c167fc14 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.154378 Nov 09 05:07:29.103420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 624/1230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:28 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:29.144689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:29.146284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:29.154235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:29.154698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:29.155461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:29.155930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:29.241085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2070c224-71c3-48ea-abfc-a6b4b199e712 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.101116 Nov 09 05:07:29.241957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 607/1231] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:29 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:30.118735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:30.119329 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:30.125489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:30.125930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:30.126683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:30.127110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:30.253928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:30.254955 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:30.258676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:30.261726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:30.262161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:30.262921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:30.263345 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:30.266099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-beb7e2b2-6955-4acf-b5f1-456bd3d25da8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.151104 Nov 09 05:07:30.266660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 625/1232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:30 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:30.356024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-daf07c7f-dec7-4771-b2b4-8313ff9722cc tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.106499 Nov 09 05:07:30.356676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 608/1233] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:30 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:31.283237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:31.284475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:31.290704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:31.291143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:31.291926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:31.292356 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:31.368741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:31.369442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:31.376344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:31.376786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:31.377551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:31.377974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:31.423354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:31.430697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a4b5b301-1433-440f-a9ae-25bef6399859 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.151032 Nov 09 05:07:31.431258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 626/1234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:31 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:31.473061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b30ed8a6-fc76-4af6-9686-6e7f57933e17 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.108755 Nov 09 05:07:31.473689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 609/1235] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:31 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:32.446881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:32.447427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:32.453640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:32.454076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:32.454837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:32.455262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:32.485024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:32.486108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:32.493136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:32.493656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:32.494501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:32.495008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:32.584147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:32.591306 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d9f8b756-9cb9-4953-acff-b6ac808e4f72 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.148197 Nov 09 05:07:32.591893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 627/1236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:32 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:32.622919 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d1905aa2-6116-4df2-9433-98c2ebc59c1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.141737 Nov 09 05:07:32.623583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 610/1237] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:32 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:33.607734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:33.608278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:33.615163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:33.615611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:33.616440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:33.616893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:33.635003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:33.636028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:33.643074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:33.643519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:33.644317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:33.644755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:33.745056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:33.755155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4f6e3d34-9e77-4e2c-a510-6b6c993ddc7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.151150 Nov 09 05:07:33.755729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 628/1238] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:33 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:33.829702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c172d4e7-878f-41ca-8d0d-8474b23abc3c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.198495 Nov 09 05:07:33.830348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 611/1239] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:33 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:34.327932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-918a50bc-7e3e-4934-a93f-bedadab74098 req-b3339cbe-8deb-4bf5-9435-3c5345765a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4805f839-96d2-42b9-8e81-1ebd537fdc33", "name": "network-vif-plugged", "status": "completed", "tag": "508ee994-7191-4353-818e-c88d4f711451"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:34.329508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:07:34.329508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:07:34.336582 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-918a50bc-7e3e-4934-a93f-bedadab74098 req-b3339cbe-8deb-4bf5-9435-3c5345765a8a service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:34.337080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-918a50bc-7e3e-4934-a93f-bedadab74098 req-b3339cbe-8deb-4bf5-9435-3c5345765a8a service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:34.348995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-918a50bc-7e3e-4934-a93f-bedadab74098 req-b3339cbe-8deb-4bf5-9435-3c5345765a8a service nova] Creating event network-vif-plugged:508ee994-7191-4353-818e-c88d4f711451 for instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 on hv-cinder-81713 Nov 09 05:07:34.354195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-918a50bc-7e3e-4934-a93f-bedadab74098 req-b3339cbe-8deb-4bf5-9435-3c5345765a8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029938 Nov 09 05:07:34.355083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 629/1240] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:07:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:07:34.771543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:34.772258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:34.778726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:34.779171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:34.779966 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:34.780398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:34.841904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:34.842904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:34.849889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:34.850339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:34.851123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:34.851563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:34.915364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:34.923014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9dff014c-f36c-4a72-b020-53d93c0a39bd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.155756 Nov 09 05:07:34.923575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 612/1241] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:34 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:35.170917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f6c9c1cf-ee77-41bd-af2d-28d9b433e54c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.332920 Nov 09 05:07:35.171551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 630/1242] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:34 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:35.940759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:35.941382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:35.947520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:35.948004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:35.948786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:35.949221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:36.079101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:36.086783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c4ef290-3f16-4609-b26d-159c3145cd83 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1363 microversion: 2.1 time: 0.150335 Nov 09 05:07:36.087355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 613/1243] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:35 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:36.182789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:36.183876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:36.191023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:36.191474 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:36.192272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:36.192696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:36.296258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cf4a208d-e5d0-4098-820f-7f349813d2f5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.117357 Nov 09 05:07:36.296866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 631/1244] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:36 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:37.103188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:37.103826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:37.110274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:37.110700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:37.111503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:37.112579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:37.236143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:07:37.243970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3c5ca08f-5c0b-49aa-9a3b-bb7126a88c6b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1550 microversion: 2.1 time: 0.144367 Nov 09 05:07:37.244542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 614/1245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:07:37 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1550 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:07:37.260507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:07:37.261076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:37.268729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:37.269171 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:37.269929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:37.270355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:37.307515 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:37.308451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:37.314231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:37.314672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:37.315517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:37.315969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:37.349929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6e82a062-5d28-4fe2-8ec6-cc85b57e0895 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093596 Nov 09 05:07:37.350521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 632/1246] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Nov 9 05:07:37 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:07:37.402025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a015cb51-55c5-41c9-96b4-07d5add3a656 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.097986 Nov 09 05:07:37.405897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 615/1247] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:37 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:38.414647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:38.415707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:38.421488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:38.421928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:38.422698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:38.423128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:38.516493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:38.517483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:38.519796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bee87cf4-11ff-4a7e-b37c-06d45be29693 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.109135 Nov 09 05:07:38.521067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 633/1248] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:38 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:38.525615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-d890d5c6-c9cc-48cf-bba3-7232681346ca req-fc0b074a-8244-4348-b287-9b37e453ce79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4805f839-96d2-42b9-8e81-1ebd537fdc33", "tag": "508ee994-7191-4353-818e-c88d4f711451"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:38.527116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:07:38.527116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:07:38.527796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:38.528261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:38.529161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:38.529732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:38.535108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d890d5c6-c9cc-48cf-bba3-7232681346ca req-fc0b074a-8244-4348-b287-9b37e453ce79 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:38.535546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d890d5c6-c9cc-48cf-bba3-7232681346ca req-fc0b074a-8244-4348-b287-9b37e453ce79 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:38.547027 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-d890d5c6-c9cc-48cf-bba3-7232681346ca req-fc0b074a-8244-4348-b287-9b37e453ce79 service nova] Creating event network-changed:508ee994-7191-4353-818e-c88d4f711451 for instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 on hv-cinder-81713 Nov 09 05:07:38.552684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-d890d5c6-c9cc-48cf-bba3-7232681346ca req-fc0b074a-8244-4348-b287-9b37e453ce79 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030911 Nov 09 05:07:38.553291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 634/1249] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:07:38.659910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bac96707-47e6-4e00-94bc-76ecc9c39bd4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.147192 Nov 09 05:07:38.661140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 616/1250] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:38 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 05:07:39.532390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:39.534780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:39.541703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:39.542260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:39.543122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:39.543557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:39.638806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ef23053d-ceb5-4757-88da-53657c6479d3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.110315 Nov 09 05:07:39.640178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 635/1251] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:39 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:39.672380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:39.673593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:39.681154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:39.681623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:39.682408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:39.683001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:39.771476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-980546fa-f5d7-49b6-8eb5-c3c123aa2eec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.104535 Nov 09 05:07:39.772153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 617/1252] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:39 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 05:07:40.652159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:40.653148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:40.660523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:40.660963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:40.661718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:40.662144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:40.748891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-304a9c52-804a-4b40-b0a0-ac12815e1c7a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.100635 Nov 09 05:07:40.749981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 636/1253] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:40 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:40.782532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:40.783518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:40.790763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:40.791216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:40.791981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:40.792405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:40.873472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2138a21a-72cb-4f7b-8f54-9a6c35681e36 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.094716 Nov 09 05:07:40.874107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 618/1254] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:40 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 05:07:41.760649 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:41.761639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:41.769174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:41.769615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:41.770381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:41.770808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:41.855651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0fbae4b2-abdd-47f1-852c-e725d40ee66b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.098776 Nov 09 05:07:41.856266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 637/1255] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:41 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:41.884987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:41.886016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:41.893310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:41.893760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:41.894557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:41.894989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:41.976591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e58b60c7-623a-403e-b944-6f97fc05341d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.095968 Nov 09 05:07:41.977452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 619/1256] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:41 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 05:07:42.866801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:42.867858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:42.874497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:42.874936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:42.875751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:42.876157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:42.973455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0ebe76f7-e0f7-4ac9-976e-6ce3bea52750 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.110658 Nov 09 05:07:42.974073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 638/1257] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:42 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:42.988183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:42.989256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:42.996096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:42.996547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:42.997326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:42.997745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:43.092457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e1f2e52f-20e0-452d-b1b0-0176eb841001 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.108225 Nov 09 05:07:43.093000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 620/1258] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:42 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 05:07:43.985203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:43.986194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:43.993052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:43.993491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:43.994257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:43.994688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:44.084093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-94165208-c8cc-498c-9cc3-5a39c01324c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.102723 Nov 09 05:07:44.085253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 639/1259] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:43 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:44.103311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:44.104279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:44.111088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:44.111533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:44.112328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:44.112761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:44.192275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-170a88f1-209e-49e0-96fe-d419fac19205 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.093546 Nov 09 05:07:44.192913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 621/1260] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:44 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 05:07:45.096633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:45.097634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:45.104636 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:45.105082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:45.105852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:45.106288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:45.204675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:45.206053 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:45.211464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-80050741-0ef0-449c-9e75-e431907f4f9c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.118455 Nov 09 05:07:45.213210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 640/1261] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:45 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:45.214991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:45.215605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:45.216443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:45.216873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:45.307147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-238e49bc-fa50-4cfd-bdee-e9eb2f8d9add tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.107978 Nov 09 05:07:45.310187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 622/1262] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:45 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 05:07:46.223107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:46.224136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:46.231434 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:46.231902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:46.232667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:46.233092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:46.318072 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:46.319059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:46.325758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:46.326199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:46.326959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:46.327383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:46.358547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c55a09ef-ac80-42a7-9698-0235b627dfec tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.139370 Nov 09 05:07:46.359418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 641/1263] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:46 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:46.410814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a6498c5c-66ea-494e-9378-1481d1df03f1 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.096579 Nov 09 05:07:46.411437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 623/1264] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:46 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 05:07:47.371405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:47.372452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:47.379249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:47.379727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:47.380527 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:47.380962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:47.421985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:47.423773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:47.431145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:47.431913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:47.432801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:47.433550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:47.473267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4989051f-0dd8-471a-8ed7-3a7068585f8b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.105828 Nov 09 05:07:47.473918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 642/1265] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:47 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:47.545811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f6c4c117-7362-4497-afee-8c3902a062d7 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.127496 Nov 09 05:07:47.546578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 624/1266] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:47 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 05:07:48.485259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:48.486258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:48.493435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:48.493872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:48.494631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:48.495059 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:48.557011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:48.557992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:48.564817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:48.565266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:48.566023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:48.566448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:48.587004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ac9269c1-a21b-4874-b0de-5a87bd3c841c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.105481 Nov 09 05:07:48.587905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 643/1267] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:48 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:48.649006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b986d79b-cb09-414f-b0dd-945204174535 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 14 microversion: 2.1 time: 0.095882 Nov 09 05:07:48.649625 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 625/1268] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:48 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 05:07:49.599187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:49.600195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:49.606932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:49.607394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:49.608179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:49.608604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:49.659512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:49.660571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:49.667601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:49.668085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:49.668895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:49.669362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:49.707290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-876789b1-0213-46b6-b9d6-abcc82fdc39b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.112014 Nov 09 05:07:49.708027 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 644/1269] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:49 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:49.779090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f0bcb9af-4bfd-4531-8bc7-30e087be2983 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 12936 microversion: 2.1 time: 0.123360 Nov 09 05:07:49.779824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 626/1270] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:49 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 12936 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:50.719565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:50.720601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:50.727995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:50.728442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:50.729207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:50.729643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:50.791081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:50.792031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:50.798863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:50.799306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:50.800118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:50.800550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:50.811866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a986ccad-00d4-4ce1-b34f-de3eeb7d50af tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.096107 Nov 09 05:07:50.812720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 645/1271] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:50 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:50.890899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1b828537-3746-45ff-ba31-b2489e7db324 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 18608 microversion: 2.1 time: 0.104269 Nov 09 05:07:50.891549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 627/1272] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:50 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 18608 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:51.824772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:51.825724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:51.832661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:51.833106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:51.833881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:51.834312 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:51.903334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:51.904350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:51.911207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:51.911679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:51.912454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:51.912885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:51.926256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-eebebd9b-3a2e-4fbc-b1df-071f297a5409 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 28645 microversion: 2.20 time: 0.105556 Nov 09 05:07:51.927111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 646/1273] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:51 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:52.025706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-556f36a6-6d32-4e2d-9943-c8b09f7ddb51 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 19342 microversion: 2.1 time: 0.126209 Nov 09 05:07:52.026580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 628/1274] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:51 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:52.938747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:52.939776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:52.946573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:52.947015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:52.947827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:52.948259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:53.036741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:53.038432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:53.046820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:53.047260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:53.047638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dffa738c-4d9e-47f7-9938-3ce9a485ba16 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 29574 microversion: 2.20 time: 0.112840 Nov 09 05:07:53.048049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:53.051489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 647/1275] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:52 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 29574 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:53.051659 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:53.141286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-99d9b2ba-4d8b-45d2-b83d-01985b4bd0f3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 21935 microversion: 2.1 time: 0.108326 Nov 09 05:07:53.141984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 629/1276] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:53 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 21935 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:54.059590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:54.060609 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:54.067433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:54.067909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:54.069182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:54.069620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:54.154637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:54.155651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:54.162475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:54.162916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:54.163703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:54.164124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:54.171382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bd4ba10e-1eab-4ad9-bbcc-b504f0c911ed tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 31522 microversion: 2.20 time: 0.115652 Nov 09 05:07:54.172305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 648/1277] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:54 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 31522 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:54.261730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-360383c3-852b-4910-ab50-99edb903f07a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 23235 microversion: 2.1 time: 0.110937 Nov 09 05:07:54.262410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 630/1278] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:54 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 23235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:07:55.184132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:55.185124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:55.191935 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:55.192380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:55.193145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:55.193577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:55.274120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:55.275106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:55.282782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:55.283204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:55.284495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:55.284955 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:55.288489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-31de854b-318d-454b-af6a-69fb36341a45 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 33059 microversion: 2.20 time: 0.108307 Nov 09 05:07:55.292891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 649/1279] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:55 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 33059 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:55.385372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c1a3d94b-44c9-4a45-aa06-2876ac1d7769 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 24732 microversion: 2.1 time: 0.115198 Nov 09 05:07:55.389187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 631/1280] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:55 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 24732 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:56.301115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:56.302110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:56.309555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:56.310000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:56.310771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:56.311204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:56.397349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:56.398343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:56.405258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:56.405698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:56.406468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:56.406898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:56.415320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2d9b2967-5af0-47d6-915b-fbeb4ffba154 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 33839 microversion: 2.20 time: 0.118133 Nov 09 05:07:56.419637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 650/1281] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:56 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 33839 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:56.506869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-49f9881c-f18c-4cee-99e3-313ab2f6fd8e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 26208 microversion: 2.1 time: 0.113572 Nov 09 05:07:56.507517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 632/1282] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:56 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 26208 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:57.427913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:57.429426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:57.436245 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:57.436695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:57.437472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:57.437910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:57.519184 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:57.520308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:57.527267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:57.527753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:57.528529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:57.528964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:57.531068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-55c27f64-5c4e-41c8-96f6-4dc442abea1c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 34972 microversion: 2.20 time: 0.107167 Nov 09 05:07:57.532783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 651/1283] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:57 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 34972 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:07:57.628014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-156a4b73-c27a-4d8e-bc13-85e67adc6e99 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 27240 microversion: 2.1 time: 0.113062 Nov 09 05:07:57.628657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 633/1284] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:57 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 27240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:58.543458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:58.544480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:58.551146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:58.551597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:58.552388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:58.552816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:58.639987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:58.640973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:58.648367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:58.648807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:58.649595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:58.650017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:58.663947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-beb87c7a-eb2f-4ad4-b59f-1d93bd3ac856 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 36109 microversion: 2.20 time: 0.124332 Nov 09 05:07:58.664953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 652/1285] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:58 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 36109 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:58.753740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e7b4b425-978d-4960-92bc-04436201d95d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 27811 microversion: 2.1 time: 0.117648 Nov 09 05:07:58.754413 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 634/1286] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:58 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 27811 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:07:59.676347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:59.677336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:59.684729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:59.685169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:59.685930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:59.686356 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:59.765502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:07:59.766490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:07:59.773459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:59.773898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:59.774682 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:07:59.775207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:07:59.780160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-622d8a67-2583-45bc-ac6c-2c2fc6eda147 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 37687 microversion: 2.20 time: 0.107700 Nov 09 05:07:59.784317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 653/1287] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:07:59 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 37687 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:07:59.873759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37078e2a-f997-4068-856e-05da663228a0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28223 microversion: 2.1 time: 0.111996 Nov 09 05:07:59.874300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 635/1288] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:07:59 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:08:00.793315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:00.794316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:00.801117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:00.801554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:00.802313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:00.802741 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:00.886199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:00.887193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:00.894327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:00.894771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:00.895534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:00.895996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:00.904893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e0adf996-410c-4937-b16c-7f39f05bb7b2 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 38201 microversion: 2.20 time: 0.115806 Nov 09 05:08:00.905778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 654/1289] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:08:00 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 38201 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:08:01.148643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-65a7475d-f789-45fd-b986-414ac4decc32 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.266664 Nov 09 05:08:01.149364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 636/1290] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:00 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:08:01.917318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:01.918318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:01.925218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:01.925671 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:01.926445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:01.926882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:02.026641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5f022dea-9260-4009-8055-38b51212d351 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 38201 microversion: 2.20 time: 0.113286 Nov 09 05:08:02.027272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 655/1291] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:08:01 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 38201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:08:02.160643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:02.161626 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:02.168397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:02.168786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:02.169539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:02.169963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:02.261938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37a04569-3aee-415f-8fa0-23870ee62144 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.105130 Nov 09 05:08:02.262545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 637/1292] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:02 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:03.039569 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:03.040597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:03.047381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:03.047866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:03.048645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:03.049085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:03.139030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-05fb0f4c-d81f-4c2f-bb58-c6e9370bc46a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 38201 microversion: 2.20 time: 0.104008 Nov 09 05:08:03.139906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 656/1293] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:08:03 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 38201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:08:03.273822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:03.274737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:03.282074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:03.282516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:03.283287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:03.283752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:03.371227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5b7a309b-1e2a-46b8-83ac-d815950e6c7e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.102004 Nov 09 05:08:03.371912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 638/1294] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:03 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:04.150834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:04.151818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:04.158620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:04.159084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:04.159872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:04.160388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:04.272965 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-397037b8-db7f-42dc-b4cc-19250814fd9b tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 38201 microversion: 2.20 time: 0.126042 Nov 09 05:08:04.273898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 657/1295] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:08:04 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 38201 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:08:04.428460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:04.429498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:04.436062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:04.436507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:04.437267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:04.437697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:04.526552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1ceb5452-a23e-4f61-8050-81332d1b2e6d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.147812 Nov 09 05:08:04.527136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 639/1296] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:04 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:05.285794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:05.286796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:05.294345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:05.294792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:05.295568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:05.296063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:05.393951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0f64b889-90d7-4b63-9771-7f515810e7a3 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action" status: 200 len: 38344 microversion: 2.20 time: 0.112099 Nov 09 05:08:05.394585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 658/1297] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 9 05:08:05 2021] POST /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/action => generated 38344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:08:05.404803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:08:05.405373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:05.412846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:05.413293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:05.414088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:05.414518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:05.437824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3e383fef-f55b-4207-bdcb-da844b04b0a1 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/ips" status: 200 len: 152 microversion: 2.20 time: 0.036999 Nov 09 05:08:05.438407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 640/1298] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Nov 9 05:08:05 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:05.539189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:05.540225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:05.546942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:05.547386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:05.548191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:05.548624 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:05.639555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e1c8de81-ccc0-4693-8e54-850bdff9c636 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.104749 Nov 09 05:08:05.640252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 659/1299] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:05 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:06.651647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:06.652561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:06.658731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:06.659170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:06.659960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:06.660415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:06.743885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8391c611-e437-4a71-93b6-ace14d75feec tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.095632 Nov 09 05:08:06.744519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 641/1300] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:06 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:07.756046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:07.757638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:07.764451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:07.764785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:07.765554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:07.765985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:07.864009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-75a332c1-9ea5-4c65-865d-49a0e5ddb82b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.111750 Nov 09 05:08:07.864585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 660/1301] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:07 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:08.874998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:08.876008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:08.883361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:08.883828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:08.884587 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:08.885017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:08.982943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2b85fcd6-0528-433f-98dd-7d3d799cb5cf tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.111819 Nov 09 05:08:08.983550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 642/1302] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:08 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:09.994677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:09.995695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:10.002472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:10.002918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:10.003712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:10.004149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:10.091352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6c00b04e-f210-4db4-9439-e2259d37ddbd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.100478 Nov 09 05:08:10.095348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 661/1303] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:09 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:11.103289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:11.104324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:11.111082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:11.111560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:11.112360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:11.112797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:11.202220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-41fef3d4-efc6-4396-a32e-d4c53d130815 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.102715 Nov 09 05:08:11.202863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 643/1304] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:11 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:11.579692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:08:11.579909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:08:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:08:12.213960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:12.214953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:12.221749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:12.222191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:12.222964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:12.223396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:12.308045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-70a992a7-5366-412f-b05d-0530ecd6df78 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.097875 Nov 09 05:08:12.308971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 662/1305] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:12 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:08:13.319795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:13.320827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:13.327572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:13.328056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:13.328819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:13.329267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:13.416233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a8e616fb-f402-42d6-ad96-6f49217ea0be tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.100279 Nov 09 05:08:13.416864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 644/1306] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:13 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:14.428024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:14.429644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:14.436384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:14.436825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:14.437588 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:14.438018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:14.521220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-783deb4d-f1e8-4ce1-9213-609cc6efe5b9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28225 microversion: 2.1 time: 0.096979 Nov 09 05:08:14.521999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 663/1307] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:14 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:15.533136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:15.534166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:15.541598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:15.542038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:15.542794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:15.543221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:15.640854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-56fa81a2-b682-4f16-8128-ca6d5aa50fe2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28516 microversion: 2.1 time: 0.111505 Nov 09 05:08:15.641466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 645/1308] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:15 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28516 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:16.652946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:16.653941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:16.660867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:16.661314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:16.662083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:16.662521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:16.758203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d2f4a141-1791-42c8-98c6-3cdfbc21f42e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28516 microversion: 2.1 time: 0.109112 Nov 09 05:08:16.758821 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 664/1309] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:16 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28516 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:17.770525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:17.771431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:17.778740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:17.779185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:17.779971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:17.780399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:17.870776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3488f037-bf5d-4cac-9a59-ddc924dc2bb4 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.104449 Nov 09 05:08:17.871408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 646/1310] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:17 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:08:18.882605 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:18.883658 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:18.890320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:18.890750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:18.891517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:18.891971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:18.984633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a6bb57a9-5fd2-453c-8e07-8ad872df8f1b tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.105915 Nov 09 05:08:18.985271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 665/1311] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:18 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:19.996867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:19.997850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:20.004591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:20.005034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:20.005795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:20.006224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:20.091012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37d12df5-f64f-42d8-8b4b-fa7efa231791 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.098507 Nov 09 05:08:20.091669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 647/1312] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:19 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:21.103159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:21.104176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:21.110935 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:21.111377 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:21.112162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:21.112608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:21.196985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a9190a2-e252-487b-9743-96788f967598 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.098226 Nov 09 05:08:21.197595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 666/1313] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:21 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:22.209098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:22.210121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:22.217368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:22.217839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:22.218597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:22.219021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:22.302860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c81be0b3-404a-49fb-b0a4-07d880a1a180 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.097801 Nov 09 05:08:22.303388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 648/1314] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:22 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:23.314654 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:23.315678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:23.322464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:23.322910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:23.323702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:23.324139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:23.409757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b9d48e8d-995e-4532-ac20-e4cf3f4cf4a6 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.098930 Nov 09 05:08:23.410583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 667/1315] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:23 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:24.421159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:24.422194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:24.429008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:24.429452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:24.430718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:24.431150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:24.516077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d4e65085-192e-4671-a07f-19b2e45f3f26 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.098782 Nov 09 05:08:24.516708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 649/1316] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:24 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:25.528772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:25.529777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:25.536544 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:25.536993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:25.537768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:25.538205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:25.620400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8e14c6f-5d1a-40ce-8154-646c532e907e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.095445 Nov 09 05:08:25.621067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 668/1317] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:25 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:26.632377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:26.633958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:26.640765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:26.641205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:26.641970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:26.642393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:26.732193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bfa0cafb-ee39-403b-9c08-28c795034dce tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.103588 Nov 09 05:08:26.732827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 650/1318] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:26 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:27.744192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:27.745199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:27.752061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:27.752540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:27.753346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:27.753786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:27.840819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-848ccaf5-d072-4470-a592-798d8c97988f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.100483 Nov 09 05:08:27.841369 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 669/1319] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:27 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:28.853322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:28.854307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:28.861061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:28.861482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:28.862238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:28.862663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:28.945437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2c14cd90-e419-4a0c-8b0c-1de6bcf5875d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.096499 Nov 09 05:08:28.946757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 651/1320] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:28 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:29.956938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:29.957870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:29.964672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:29.965111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:29.965873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:29.966302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:30.056082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2061824a-f0da-49c9-b5a6-22bca46f5def tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.102416 Nov 09 05:08:30.056737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 670/1321] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:29 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:31.068003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:31.068997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:31.075675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:31.076135 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:31.076891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:31.077317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:31.160458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e4c45c5b-9eb0-418a-af79-f8007e6d4311 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.096235 Nov 09 05:08:31.161329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 652/1322] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:31 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:32.174077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:32.175105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:32.181979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:32.182427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:32.183204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:32.183652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:32.266600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-49a6b52b-6b84-42e9-a2bd-d680062a54ba tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.096455 Nov 09 05:08:32.267455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 671/1323] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:32 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:33.279205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:33.280227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:33.286931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:33.287370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:33.288155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:33.288583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:33.370746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2ff213f7-359d-489e-9e68-790e5b0d52fd tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.095406 Nov 09 05:08:33.371359 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 653/1324] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:33 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:34.381962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:34.383572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:34.390342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:34.390789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:34.391560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:34.392020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:34.477525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d2448621-cea0-4fc4-b57e-09441bb3d16f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.099473 Nov 09 05:08:34.478070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 672/1325] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:34 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:35.489363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:35.490278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:35.497063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:35.497506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:35.498259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:35.498686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:35.596327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-01a4147f-8741-44a3-b112-0b60fb2159c2 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.110813 Nov 09 05:08:35.597215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 654/1326] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:35 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:36.609056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:36.610075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:36.616846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:36.617287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:36.618050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:36.618507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:36.700345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-449f7484-fd5d-49b4-8633-89dab9045e29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.095145 Nov 09 05:08:36.700952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 673/1327] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:36 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:37.712853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:37.713843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:37.720649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:37.721091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:37.721854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:37.722281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:37.803680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b4ea23d8-2507-4cd6-b133-ef803eb33cc3 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.095332 Nov 09 05:08:37.804292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 655/1328] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:37 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:38.814962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:38.815920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:38.822681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:38.823124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:38.823914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:38.824345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:38.910418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3c102495-7518-44fd-a667-91c751e6f477 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.099346 Nov 09 05:08:38.911236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 674/1329] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:38 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:08:39.922898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:39.923937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:39.931727 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:39.932176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:39.932948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:39.933381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:40.017933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7bb4c017-a293-42da-8838-5ddc4a56675d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.098864 Nov 09 05:08:40.018809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 656/1330] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:39 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:41.030085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:41.031077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:41.037841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:41.038286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:41.039130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:41.039562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:41.122073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b7fe2876-c217-4496-a63f-b709a3c78332 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.095809 Nov 09 05:08:41.122688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 675/1331] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:41 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:42.134635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:42.135683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:42.145140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:42.145908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:42.147251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:42.148040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:42.235080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37eb2ffa-fdb8-4f6c-8e9c-4225761bcbe0 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.104889 Nov 09 05:08:42.236044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 657/1332] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:42 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:43.247153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:43.248224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:43.255113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:43.255561 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:43.256401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:43.256842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:43.381906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bd2cc091-9efb-4a0a-aa9c-f6c441922a12 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.138758 Nov 09 05:08:43.382560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 676/1333] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:43 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:44.394583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:44.395576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:44.403052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:44.403496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:44.404290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:44.404717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:44.500732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-efd9fdba-66d2-4d67-ba8f-75463c2fde1f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 28684 microversion: 2.1 time: 0.110382 Nov 09 05:08:44.501337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 658/1334] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:44 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 28684 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:45.512723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:45.513653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:45.520685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:45.521123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:45.521885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:45.522313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:45.614576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-45c5864c-5866-48dd-bcd5-b3f98dc1ef96 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 29478 microversion: 2.1 time: 0.105730 Nov 09 05:08:45.615241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 677/1335] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:45 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 29478 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 05:08:46.626662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:46.627670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:46.634565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:46.635006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:46.635808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:46.636235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:46.727170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bd287a20-b4ad-491d-9080-a6d4831fb85a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 31576 microversion: 2.1 time: 0.103856 Nov 09 05:08:46.727801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 659/1336] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:46 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 31576 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:47.739093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:47.740247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:47.747047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:47.747490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:47.748278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:47.748706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:47.852589 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-80a922eb-9b33-4ef4-bf57-02c8954c83d8 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 32861 microversion: 2.1 time: 0.116688 Nov 09 05:08:47.853517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 678/1337] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:47 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 32861 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:48.864933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:48.865849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:48.872558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:48.873011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:48.873783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:48.874215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:48.982943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-55af3543-ab45-479d-9459-5297308c2c1d tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 33898 microversion: 2.1 time: 0.121923 Nov 09 05:08:48.987006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 660/1338] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:48 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 33898 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:49.995219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:49.996247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:50.002989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:50.003432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:50.004246 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:50.004684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:50.096722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7d494e89-cde2-440f-9389-c77cb46fb082 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 35317 microversion: 2.1 time: 0.105830 Nov 09 05:08:50.097390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 679/1339] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:49 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 35317 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:51.108419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:51.109404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:51.116198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:51.116642 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:51.117392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:51.117817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:51.210062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c0e5831a-3127-4daf-98cd-7615182e884f tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 36933 microversion: 2.1 time: 0.105484 Nov 09 05:08:51.210838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 661/1340] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:51 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 36933 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:52.222716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:52.223959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:52.231211 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:52.231679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:52.232454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:52.232892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:52.324337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2a5c2a9e-d348-46d1-9768-e0797c937a29 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 38213 microversion: 2.1 time: 0.105389 Nov 09 05:08:52.324922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 680/1341] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:52 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 38213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:53.336605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:53.337513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:53.344320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:53.344769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:53.345535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:53.345969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:53.432293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3e32f2c3-c5ad-4083-a852-42e6aaca0f07 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 38213 microversion: 2.1 time: 0.099638 Nov 09 05:08:53.432904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 662/1342] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:53 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 38213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:54.444640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:54.445579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:54.452510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:54.452960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:54.453738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:54.454176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:54.542167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c1d2ac43-e73f-4eb0-8579-336bb8665651 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 38213 microversion: 2.1 time: 0.101530 Nov 09 05:08:54.542780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 681/1343] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:54 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 38213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:55.554641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:55.555553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:55.562451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:55.562895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:55.563681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:55.564173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:55.655287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-56df661d-8d54-46a0-afec-f4eb5eb5d9e9 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 38213 microversion: 2.1 time: 0.104637 Nov 09 05:08:55.655964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 663/1344] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:55 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 38213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:56.668871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:08:56.669856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:56.676657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:56.677104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:56.677865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:56.678294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:56.767798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-242ceb81-0279-4176-8d17-d18b32e0cecb tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action" status: 200 len: 38342 microversion: 2.1 time: 0.103284 Nov 09 05:08:56.773982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 682/1345] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:08:56 2021] POST /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/action => generated 38342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 05:08:56.779118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:08:56.779723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:08:56.786530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:56.786971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:56.787766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:08:56.788465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:08:56.812296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d00b04cb-0b20-43cd-8b08-46314961e702 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/ips" status: 200 len: 147 microversion: 2.1 time: 0.037048 Nov 09 05:08:56.812875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 664/1346] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 9 05:08:56 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:09:51.576527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:09:51.577151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:09:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:09:54.322913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:09:54.323374 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:09:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:09:58.360308 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:09:58.360919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:09:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:11:31.598484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:11:31.599012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:11:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:12:01.850366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:12:01.850987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:12:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:12:03.688158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72aeebc8-7b41-4ca4-acaa-c7dc623a4daa] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 09 05:12:03.691892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:03.692463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:03.698382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:03.698820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:03.699591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:03.700049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:03.724313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:12:03.801597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3cd7b15c-57e5-43e9-b6b7-436ab361ea24 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 204 len: 0 microversion: 2.1 time: 0.115199 Nov 09 05:12:03.802333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 683/1347] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:12:03 2021] DELETE /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:12:03.810129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ccbb107-0d10-4610-97f2-19b064307277] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 09 05:12:03.813838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:03.814571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:03.820845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:03.821226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:03.822153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:03.822583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:04.072775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:04.080391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-15d0b0c7-60ce-4df9-8a7d-2b0ac2b650e9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.272526 Nov 09 05:12:04.080946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 665/1348] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:04.138683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:12:04.138834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:12:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:12:05.097598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:05.098237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:05.115804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:05.116294 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:05.117081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:05.117520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:05.125666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] [72aeebc8-7b41-4ca4-acaa-c7dc623a4daa] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38342. Nov 09 05:12:05.297906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:05.305763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2c0ed46d-d0aa-42c0-af3c-d80361ec135c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.212330 Nov 09 05:12:05.306328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 684/1349] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:05 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:06.325223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:06.325850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:06.344002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:06.344469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:06.345247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:06.345674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:06.353022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ccbb107-0d10-4610-97f2-19b064307277] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38356. Nov 09 05:12:06.477280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:06.484892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b2715ba6-78e6-4fae-a175-e7bb4ac3ec7f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.165695 Nov 09 05:12:06.485442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 666/1350] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:06.858201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:06.858694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:06.865813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:06.866259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:06.867056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:06.867485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:06.891832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:12:06.979463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7206ea3c-c0ca-4255-8b03-58db08170811 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 204 len: 0 microversion: 2.1 time: 0.124505 Nov 09 05:12:06.980233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 685/1351] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:12:06 2021] DELETE /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:12:06.990068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:06.990670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:06.997475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:06.997920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:06.998717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:06.999139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:07.128090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:07.136068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f809a51f-3d7a-466d-8ba1-c2e198be8d1f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1514 microversion: 2.1 time: 0.149679 Nov 09 05:12:07.136625 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 667/1352] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:06 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:07.502470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:07.503166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:07.509430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:07.509874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:07.510648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:07.511083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:07.641865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:07.650248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-378a5974-cee7-4562-9044-64920c189db3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151823 Nov 09 05:12:07.650912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 686/1353] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:07 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:08.153337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:08.153956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:08.160336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:08.160849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:08.161620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:08.162050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:08.290879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:08.298414 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-92a59d34-9872-4c46-9d93-2962656f3a0f tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 200 len: 1514 microversion: 2.1 time: 0.148867 Nov 09 05:12:08.299170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 668/1354] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:08 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:08.400409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-3d3c7cc9-000b-4fe6-8dfe-2cce69ecc87c req-83f6b9ea-6b10-4f28-8ed1-aa33b46361fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3376205e-2dfb-4a11-bf1d-f56697031624", "name": "network-vif-deleted", "tag": "b4486560-446e-4f4a-b732-29ca12b603ba"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:12:08.402152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:12:08.402152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:12:08.409835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-3d3c7cc9-000b-4fe6-8dfe-2cce69ecc87c req-83f6b9ea-6b10-4f28-8ed1-aa33b46361fd service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:08.410205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-3d3c7cc9-000b-4fe6-8dfe-2cce69ecc87c req-83f6b9ea-6b10-4f28-8ed1-aa33b46361fd service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:08.421890 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-3d3c7cc9-000b-4fe6-8dfe-2cce69ecc87c req-83f6b9ea-6b10-4f28-8ed1-aa33b46361fd service nova] Creating event network-vif-deleted:b4486560-446e-4f4a-b732-29ca12b603ba for instance 3376205e-2dfb-4a11-bf1d-f56697031624 on hv-cinder-81713 Nov 09 05:12:08.427776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-3d3c7cc9-000b-4fe6-8dfe-2cce69ecc87c req-83f6b9ea-6b10-4f28-8ed1-aa33b46361fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032158 Nov 09 05:12:08.428871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 687/1355] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:12:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:12:08.668067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:08.668587 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:08.674701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:08.675138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:08.675919 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:08.676346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:08.801198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:08.809281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7c05ffa0-72a2-43dc-b07a-bca1e2458104 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145710 Nov 09 05:12:08.809839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 669/1356] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:08 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:09.316572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:09.317175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 3376205e-2dfb-4a11-bf1d-f56697031624] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:09.323825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.324285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.325052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.325493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.339198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] HTTP exception thrown: Instance 3376205e-2dfb-4a11-bf1d-f56697031624 could not be found. Nov 09 05:12:09.339816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Returning 404 to user: Instance 3376205e-2dfb-4a11-bf1d-f56697031624 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:12:09.340630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9a11a597-210d-416e-a0bb-5a33858a05a0 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624" status: 404 len: 111 microversion: 2.1 time: 0.028211 Nov 09 05:12:09.341157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 688/1357] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:09 2021] GET /compute/v2.1/servers/3376205e-2dfb-4a11-bf1d-f56697031624 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:12:09.349065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:09.349598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:09.355958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.356752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.357996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.358437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.389241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:12:09.462853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ce6d56e8-7d60-4881-ba34-80df23d47051 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 204 len: 0 microversion: 2.1 time: 0.117075 Nov 09 05:12:09.463362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 670/1358] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:12:09 2021] DELETE /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:12:09.471642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:09.472249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:09.478520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.478955 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.479778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.480207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.611135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:09.619095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e7f80e88-7202-48b7-91c8-c7630793ef4e tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1514 microversion: 2.1 time: 0.150486 Nov 09 05:12:09.619754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 689/1359] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:09 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:09.826075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:09.826704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:09.832872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.833305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.834101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:09.834526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:09.970731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:09.978914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5a34b282-446d-4768-b288-04f961400a8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.156955 Nov 09 05:12:09.979471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 671/1360] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:10.637048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:10.637963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:10.645016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:10.646234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:10.646969 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:10.647492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:10.853736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:10.861033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b4315f38-3649-4533-925b-a7a26bf0eabc tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 200 len: 1514 microversion: 2.1 time: 0.228302 Nov 09 05:12:10.861526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 690/1361] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:10 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:10.995316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:10.995967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:11.002452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:11.002863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:11.003669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:11.004121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:11.009831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-d4d29f0d-1183-4bb2-89c3-f568a88412c6 req-05642c8d-6eac-400f-b5ce-0b204a24ece4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4587bfc-3272-4893-a25b-9e3cdbcd8f47", "name": "network-vif-deleted", "tag": "ac852503-70fb-48a9-b3d8-4f2cac27b230"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:12:11.011736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:12:11.011736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:12:11.019387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d4d29f0d-1183-4bb2-89c3-f568a88412c6 req-05642c8d-6eac-400f-b5ce-0b204a24ece4 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:11.020150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-d4d29f0d-1183-4bb2-89c3-f568a88412c6 req-05642c8d-6eac-400f-b5ce-0b204a24ece4 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:11.033218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-d4d29f0d-1183-4bb2-89c3-f568a88412c6 req-05642c8d-6eac-400f-b5ce-0b204a24ece4 service nova] Creating event network-vif-deleted:ac852503-70fb-48a9-b3d8-4f2cac27b230 for instance f4587bfc-3272-4893-a25b-9e3cdbcd8f47 on hv-cinder-81713 Nov 09 05:12:11.039805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-d4d29f0d-1183-4bb2-89c3-f568a88412c6 req-05642c8d-6eac-400f-b5ce-0b204a24ece4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Nov 09 05:12:11.041206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 691/1362] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:12:11.172761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:11.180954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c8bc3df6-ccf6-4655-93e7-e878b6518106 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.189712 Nov 09 05:12:11.182100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 672/1363] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:10 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:11.879611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:11.880365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: f4587bfc-3272-4893-a25b-9e3cdbcd8f47] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:11.886895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:11.887342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:11.888152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:11.888586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:11.902247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] HTTP exception thrown: Instance f4587bfc-3272-4893-a25b-9e3cdbcd8f47 could not be found. Nov 09 05:12:11.902822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Returning 404 to user: Instance f4587bfc-3272-4893-a25b-9e3cdbcd8f47 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:12:11.903652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9a7b9562-b5c1-47ed-9d69-b35279ba013c tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47" status: 404 len: 111 microversion: 2.1 time: 0.028568 Nov 09 05:12:11.904161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 692/1364] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:11 2021] GET /compute/v2.1/servers/f4587bfc-3272-4893-a25b-9e3cdbcd8f47 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:12:12.198252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:12.198852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:12.205017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:12.205463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:12.206222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:12.206844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:12.334597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:12.342291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1b36bcda-0524-4539-bc07-6bbc0ff4f2f8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148114 Nov 09 05:12:12.342840 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 673/1365] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:12 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:13.358547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:13.359090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:13.365338 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:13.365788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:13.366566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:13.367006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:13.493157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:13.502853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bc994431-bedd-4156-9f0d-a3fb5c93b605 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147664 Nov 09 05:12:13.503879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 693/1366] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:13 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:14.521898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:14.522499 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:14.528748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:14.529196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:14.529959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:14.530386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:14.657105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:14.664710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-afb81cf0-c6ef-43fa-ad85-917526235374 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146742 Nov 09 05:12:14.665269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 674/1367] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:14 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:15.681363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:15.681973 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:15.688320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:15.688768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:15.689540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:15.689972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:15.819400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:15.827723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-98d960fc-1b5a-4885-81b6-a25fff47dc68 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150026 Nov 09 05:12:15.828285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 694/1368] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:15 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:16.845205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:16.845741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:16.851995 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:16.852430 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:16.853752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:16.854174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:16.983867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:16.991478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-554e72b7-de05-4151-a420-7d0d241de778 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150034 Nov 09 05:12:16.992066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 675/1369] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:16 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:18.008506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:18.009666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:18.015924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:18.016373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:18.017142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:18.017828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:18.142295 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:18.150227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-70099093-458c-4f87-8545-0ddc71207314 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145389 Nov 09 05:12:18.150791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 695/1370] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:18 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:19.167724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:19.168319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:19.174520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:19.174958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:19.175746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:19.176166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:19.314412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:19.322663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5444a49a-2ab7-4905-afa6-3e50a872e55b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.159164 Nov 09 05:12:19.323317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 676/1371] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:19 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:20.339764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:20.340326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:20.346539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:20.346991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:20.347807 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:20.348248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:20.478641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:20.486502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c35c98fb-3f65-454b-a9b5-e3cd7bb6c25e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151169 Nov 09 05:12:20.487068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 696/1372] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:20 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:21.503280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:21.503902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:21.510857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:21.511295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:21.512086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:21.512522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:21.643389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:21.651158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76a1d7ef-9ab5-4c64-b4f1-3eff2e018032 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151529 Nov 09 05:12:21.651746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 677/1373] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:21 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:22.668274 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:22.668824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:22.674960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:22.675407 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:22.676216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:22.676655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:22.809643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:22.817332 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-194dedff-0635-4021-8ba8-f14e05c938ec tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153791 Nov 09 05:12:22.817899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 697/1374] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:22 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:23.833386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:23.833949 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:23.840618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:23.841060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:23.841812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:23.842236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:23.971531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:23.979161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-81321b72-1713-493a-a6aa-eec958f0281f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149566 Nov 09 05:12:23.979726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 678/1375] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:23 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:24.996552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:24.997155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:25.003348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:25.003843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:25.004599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:25.005024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:25.129843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:25.137492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-63e05b2c-476d-44b9-98ab-f6a7db24b9cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145204 Nov 09 05:12:25.138047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 698/1376] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:24 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:26.154819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:26.155444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:26.161686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:26.162128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:26.162877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:26.163299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:26.288627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:26.296730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a9bb45d6-6c60-4eac-9618-94b4c9480625 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145565 Nov 09 05:12:26.297270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 679/1377] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:26 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:27.313149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:27.313746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:27.319937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:27.320366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:27.321149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:27.321581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:27.452992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:27.460760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3e25e6e1-e34a-4047-a907-f3654e461067 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151335 Nov 09 05:12:27.461328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 699/1378] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:27 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:28.477999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:28.478622 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:28.484752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:28.485197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:28.485946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:28.486370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:28.614407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:28.622020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a6eb6888-1e55-4b99-9c70-01e0715f6845 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147708 Nov 09 05:12:28.622576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 680/1379] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:28 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:29.639297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:29.639927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:29.646420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:29.646862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:29.647645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:29.648150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:29.774408 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:29.782108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-334f513e-bdd7-49ef-bf4d-0428dd2c98d5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146532 Nov 09 05:12:29.782672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 700/1380] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:29 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:30.797944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:30.798670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:30.805060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:30.805526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:30.806293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:30.806725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:30.937937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:30.946085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b10355c0-df9c-404d-8635-e6120e4874a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151637 Nov 09 05:12:30.946673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 681/1381] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:30 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:31.963497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:31.964139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:31.970071 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:31.970622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:31.971286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:31.971756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:32.104592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:32.112324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9f4653fe-b91f-4f56-9b6d-ef3548b6761f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152863 Nov 09 05:12:32.112889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 701/1382] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:31 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:33.128528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:33.129241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:33.136001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:33.136445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:33.137205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:33.137634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:33.263690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:33.271554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-107802d1-f49a-4c89-b588-919be58c8cd2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146753 Nov 09 05:12:33.272143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 682/1383] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:33 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:12:34.288522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:34.289040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:34.295911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:34.296359 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:34.297130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:34.297564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:34.424369 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:34.432672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-23dfbe49-e40d-4de4-9388-8e6d56b53f07 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147927 Nov 09 05:12:34.433217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 702/1384] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:34 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:35.449145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:35.449752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:35.456027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:35.456469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:35.457230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:35.457657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:35.587186 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:35.594968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ab9ddd78-1d00-44d4-a1a4-8232818975cf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149524 Nov 09 05:12:35.595537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 683/1385] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:35 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:36.612505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:36.613145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:36.619404 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:36.619917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:36.620694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:36.621124 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:36.747638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:36.755322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed031df7-5845-49f9-969e-53c4d56e44a2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146714 Nov 09 05:12:36.755910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 703/1386] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:36 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:37.772369 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:37.772996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:37.779448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:37.779936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:37.780687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:37.781114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:37.907598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:37.916144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-842c530c-0152-4d79-a70c-8a0770a7db08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147443 Nov 09 05:12:37.916704 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 684/1387] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:37 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:38.932805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:38.933414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:38.940621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:38.941068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:38.942288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:38.942725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:39.076315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:39.084065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6194e846-d897-4682-ba4c-57a8973976eb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155025 Nov 09 05:12:39.084665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 704/1388] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:38 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:40.100669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:40.101347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:40.108243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:40.108691 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:40.109757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:40.110191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:40.240442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:40.248137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8108b5b2-3d25-4f07-8ded-c25d7d87ddbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151115 Nov 09 05:12:40.248701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 685/1389] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:40 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:41.264498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:41.265099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:41.271543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:41.272030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:41.272803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:41.273235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:41.404798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:41.412679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2cb69d46-1c32-4e51-87bd-3eb4c62a11ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151784 Nov 09 05:12:41.413248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 705/1390] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:41 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:42.428650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:42.429231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:42.435920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:42.436266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:42.437035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:42.437458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:42.563146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:42.570844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c22c5771-fe08-4384-8fce-e28507200bfa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145904 Nov 09 05:12:42.571401 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 686/1391] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:42 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:43.588491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:43.589095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:43.595416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:43.595889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:43.596655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:43.597083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:43.728707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:43.736347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-61311745-fa3f-4320-a0b5-ee77e7035825 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152196 Nov 09 05:12:43.736904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 706/1392] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:43 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:44.753453 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:44.753962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:44.760831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:44.761265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:44.762018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:44.762444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:44.888835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:44.896715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9826c9fe-6a31-4fc9-8ad1-b64c571a71b9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146980 Nov 09 05:12:44.897262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 687/1393] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:45.912976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:45.913709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:45.920543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:45.920992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:45.921772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:45.922208 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:46.053272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:46.060934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4a05a7bc-3f8b-4baf-8fb1-d0fcf2241167 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151654 Nov 09 05:12:46.061497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 707/1394] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:45 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:47.079405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:47.080115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:47.086424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:47.086877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:47.088168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:47.088734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:47.217358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:47.225068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ea26733d-5970-47d0-b501-dce6bbcb3aad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150856 Nov 09 05:12:47.225635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 688/1395] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:47 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:48.241662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:48.242255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:48.249057 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:48.249499 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:48.250263 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:48.250690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:48.379547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:48.387813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c45c6346-fa0e-415a-a2fa-324b7c25cfeb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149853 Nov 09 05:12:48.388376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 708/1396] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:49.405269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:49.405892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:49.412136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:49.412580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:49.413344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:49.413774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:49.540780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:49.549294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4914766a-e004-4628-bcc0-4efc1228f6af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147719 Nov 09 05:12:49.549874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 689/1397] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:49 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:50.567151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:50.567807 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:50.574066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:50.574514 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:50.575296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:50.575772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:50.705169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:50.713453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-695620ad-1179-418c-a1ae-260b7656dbd3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149479 Nov 09 05:12:50.714064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 709/1398] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:50 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:51.731303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:51.731948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:51.738275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:51.744887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:51.747244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:51.747728 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:51.875075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:51.882754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-28d8a648-8fb8-47b5-8006-d5d957bcafae tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155940 Nov 09 05:12:51.883322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 690/1399] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:52.899300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:52.899928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:52.906675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:52.907152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:52.907956 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:52.908386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:53.056362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:53.064337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bdc51e77-b6fc-48b0-ab55-fae3b2a9d1db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.168745 Nov 09 05:12:53.064896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 710/1400] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:52 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:54.080639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:54.081269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:54.087498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:54.088553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:54.089311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:54.089736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:54.214678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:54.222311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-88fe7ce6-8e91-48ee-9d24-df646f26b53f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145278 Nov 09 05:12:54.222873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 691/1401] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:54 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:55.239469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:55.240239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:55.247206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:55.247681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:55.248466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:55.248900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:55.709577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:55.718008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ae6194f7-42cd-44cc-bd21-48d749106c7d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.482251 Nov 09 05:12:55.718750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 711/1402] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:55 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:56.734388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:56.734967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:56.741286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:56.741726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:56.742479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:56.742904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:56.874330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:56.882311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c91e8b68-26fc-44bd-b6e0-2e3ee6aedacd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151530 Nov 09 05:12:56.882875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 692/1403] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:57.898180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:57.898777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:57.905677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:57.906115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:57.906879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:57.907412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:58.038481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:58.046219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-edc7b3ad-050a-42c4-9e21-1fba2307a800 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151762 Nov 09 05:12:58.046777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 712/1404] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:57 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:12:59.062772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:12:59.063388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:12:59.069703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:59.070147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:59.070912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:12:59.071344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:12:59.198713 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:12:59.206428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-01164802-622c-498d-83ef-67c588cbb806 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147272 Nov 09 05:12:59.207009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 693/1405] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:12:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:00.223004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:00.223645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:00.230419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:00.230858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:00.231653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:00.232075 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:00.363672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:00.371429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4300ad31-5aa0-4d43-b880-5b15637ebbc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152108 Nov 09 05:13:00.372037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 713/1406] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:00 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:01.387199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:01.387849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:01.394344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:01.394837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:01.395649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:01.396085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:01.524554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:01.532517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-da73c795-9932-4810-9f5f-1a4955c85e69 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149005 Nov 09 05:13:01.533067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 694/1407] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:02.548962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:02.549572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:02.555927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:02.556373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:02.557150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:02.558083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:02.684068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:02.691758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7408ee64-7266-4dbc-908e-bb5cec9b7f62 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146499 Nov 09 05:13:02.692323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 714/1408] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:02 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:13:03.708662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:03.709200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:03.717421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:03.717872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:03.718943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:03.719385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:03.851830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:03.860201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bd2fac60-cab0-477e-9db1-e45f14752d2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155294 Nov 09 05:13:03.860779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 695/1409] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:04.876926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:04.877539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:04.884045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:04.884495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:04.885291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:04.885760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:05.018039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:05.025731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-09cfe601-98d2-44d5-acfc-461ad0f934b2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152554 Nov 09 05:13:05.026824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 715/1410] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:04 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:06.042892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:06.043494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:06.049755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:06.050196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:06.050956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:06.051383 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:06.175516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:06.183760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8128748d-a358-450e-8d87-9d6c968e44a1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144980 Nov 09 05:13:06.184324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 696/1411] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:07.200189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:07.200782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:07.206735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:07.207179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:07.207972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:07.208405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:07.334786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:07.342455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fdf347ae-8bfb-43da-9a7a-23b02743a3e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146654 Nov 09 05:13:07.343017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 716/1412] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:07 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:08.359276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:08.359916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:08.367829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:08.368286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:08.369072 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:08.369508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:08.504286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:08.514104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e6a93d51-d44c-4056-8683-23c8c1850176 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.158047 Nov 09 05:13:08.515063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 697/1413] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:08 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:09.531840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:09.532477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:09.538783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:09.539230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:09.540033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:09.540470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:09.671729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:09.679504 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3cf7fd6a-e150-4f7d-a14d-e5c0fc2c1531 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151304 Nov 09 05:13:09.680114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 717/1414] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:10.696225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:10.696828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:10.703503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:10.703995 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:10.704761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:10.705191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:10.832953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:10.841116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e5de9591-7b88-4802-89c0-364b73c4ab18 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148571 Nov 09 05:13:10.841679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 698/1415] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:10 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:11.594059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:13:11.594258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:13:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:13:11.857269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:11.857874 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:11.864081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:11.864527 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:11.865296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:11.865725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:11.995798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:12.003540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-29d000ed-7da5-465c-ad2e-2e46163326fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150445 Nov 09 05:13:12.004133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 718/1416] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:11 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:13.020650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:13.021169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:13.027443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:13.027918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:13.028683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:13.029129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:13.154961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:13.162572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-859df3ef-24d6-4686-9194-c4dfdd0de522 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145944 Nov 09 05:13:13.163133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 699/1417] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:13 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:14.179552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:14.180144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:14.186360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:14.186800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:14.187566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:14.188030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:14.314491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:14.322145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a0515552-a1af-4ad0-a7be-f303c7a047db tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146326 Nov 09 05:13:14.322706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 719/1418] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:14 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:14.339682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:13:14.339829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:13:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:13:15.338037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:15.338573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:15.344726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:15.345169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:15.345932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:15.346360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:15.474102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:15.482059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fccd0188-cc12-4541-815a-4c80daa999fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147748 Nov 09 05:13:15.482628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 700/1419] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:15 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:16.499005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:16.499601 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:16.505857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:16.506325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:16.507089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:16.507517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:16.641044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:16.649214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0079bd26-6431-4228-b6c0-65c057c4983f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.154522 Nov 09 05:13:16.649778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 720/1420] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:16 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:17.665060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:17.665658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:17.671860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:17.672297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:17.673051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:17.673471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:17.800589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:17.809399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-70c005c7-ecb8-4cc9-b239-0c6dd3955f96 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147863 Nov 09 05:13:17.816076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 701/1421] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:17 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:18.377440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:13:18.377840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:13:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:13:18.825562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:18.826170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:18.832344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:18.832789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:18.833562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:18.833993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:18.960710 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:18.968826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7eb91f6d-d495-43ce-b196-562dd2b24689 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146920 Nov 09 05:13:18.969381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 721/1422] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:18 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:19.985534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:19.986139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:19.992318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:19.992760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:19.993547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:19.993978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:20.125286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:20.132972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4e1057c6-fc25-4f6c-a77e-6cd6e323cefc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151036 Nov 09 05:13:20.133528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 702/1423] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:19 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:21.149788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:21.150394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:21.157284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:21.157725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:21.158486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:21.158914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:21.287147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:21.294860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d20ada79-fdc5-40ed-8691-42e038dd90a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148772 Nov 09 05:13:21.295424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 722/1424] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:21 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:22.311158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:22.311800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:22.318034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:22.318477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:22.319243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:22.319748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:22.445205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:22.453558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fbef5613-29e3-4453-b28a-cc2ce8232e8b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146056 Nov 09 05:13:22.454119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 703/1425] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:22 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:23.470342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:23.470947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:23.477344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:23.477602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:23.478373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:23.479746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:23.612372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:23.624279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2bc6feb9-74af-4b0d-bdf8-1cb4b86852ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157817 Nov 09 05:13:23.624855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 723/1426] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:23 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:24.641352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:24.641948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:24.648375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:24.648811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:24.649563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:24.649984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:24.782632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:24.790438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b66b4591-93d5-42ba-bb67-270ee9002936 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152793 Nov 09 05:13:24.791005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 704/1427] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:24 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:25.806128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:25.806666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:25.813457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:25.813900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:25.814658 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:25.815084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:25.941590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:25.949871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3b9d06b4-e671-4e7f-a7a1-d4809856daef tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147512 Nov 09 05:13:25.950427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 724/1428] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:25 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:26.966360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:26.966960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:26.973222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:26.973664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:26.974429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:26.974856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:27.099913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:27.108084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-217ef7c4-1d75-45c0-8f7c-52b7cee8b327 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145389 Nov 09 05:13:27.108638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 705/1429] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:26 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:28.124284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:28.124903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:28.131149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:28.131597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:28.132401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:28.132836 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:28.264224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:28.272614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-964e31d0-eaea-4ec1-9f5d-d2ccabe338c2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152037 Nov 09 05:13:28.273183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 725/1430] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:28 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:29.289438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:29.290022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:29.296334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:29.296766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:29.297519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:29.297941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:29.426177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:29.434932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-18510ae6-0697-4432-93a4-a71a859b917a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149194 Nov 09 05:13:29.435496 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 706/1431] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:29 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:30.451495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:30.452141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:30.458254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:30.458691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:30.459450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:30.459917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:30.585993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:30.594355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6f98a60b-9df8-45ef-a605-573f2c4be210 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146536 Nov 09 05:13:30.594910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 726/1432] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:30 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:31.610873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:31.611479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:31.617817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:31.618258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:31.619016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:31.619467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:31.762410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:31.770470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e70349d6-1a61-43e7-94aa-661adcf81561 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.163225 Nov 09 05:13:31.771032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 707/1433] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:31 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:32.912222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:32.913003 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:32.919361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:32.919835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:32.920600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:32.921025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:33.053963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:33.062301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-901f3751-c87a-42a8-9f84-5ed18eaa2068 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.278621 Nov 09 05:13:33.062866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 727/1434] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:32 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:34.078379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:34.078937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:34.085113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:34.085548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:34.086301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:34.086724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:34.210744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:34.218863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ae9ec3e7-e8fc-4cdd-82ef-feaac5a04638 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144238 Nov 09 05:13:34.219421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 708/1435] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:34 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:35.235327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:35.235940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:35.241766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:35.242221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:35.242996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:35.243501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:35.375638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:35.383424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d78ad252-8cff-4c7e-808f-31e812733e09 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151766 Nov 09 05:13:35.384017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 728/1436] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:35 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:36.400396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:36.401001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:36.406842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:36.407379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:36.408178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:36.408613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:36.535415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:36.543046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1eb0f990-047d-4369-a1ae-7a3ba4a7f8dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146452 Nov 09 05:13:36.544165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 709/1437] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:36 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:37.560355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:37.560937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:37.567311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:37.567782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:37.568547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:37.568972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:37.697467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:37.705736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cac8b13b-ded9-4552-a3ce-e02c1a656e88 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149095 Nov 09 05:13:37.706293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 729/1438] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:37 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:38.722495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:38.723020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:38.729270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:38.729713 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:38.730472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:38.731533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:38.859791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:38.867420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5219a921-db35-408f-bc40-8f7f2666105e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148926 Nov 09 05:13:38.868001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 710/1439] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:38 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:39.883884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:39.884487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:39.891567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:39.892397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:39.893169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:39.893599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:40.024090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:40.032021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4bca2939-d2f7-491d-85fc-9a0962e3cb6b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151690 Nov 09 05:13:40.032608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 730/1440] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:39 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:41.049031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:41.049672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:41.056029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:41.056545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:41.057331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:41.057763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:41.183544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:41.191310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7f8c69d5-c926-4e0e-8022-2e11fa4189c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145959 Nov 09 05:13:41.191906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 711/1441] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:41 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:42.208000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:42.208543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:42.214722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:42.215771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:42.216528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:42.216954 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:42.344159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:42.351973 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b7449d52-c82f-413b-b924-0a4bf66b7b76 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147624 Nov 09 05:13:42.352547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 731/1442] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:42 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:43.368847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:43.369447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:43.376337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:43.376778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:43.377544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:43.377999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:43.505296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:43.512928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-65759b5d-2c1d-4620-bf6b-322e7d6b2aed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147959 Nov 09 05:13:43.513491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 712/1443] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:43 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:44.529865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:44.530469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:44.536749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:44.537193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:44.537962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:44.538395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:44.670340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:44.678046 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bf65fb10-1bfe-4919-a686-3f1312c546d3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151958 Nov 09 05:13:44.678616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 732/1444] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:45.694661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:45.695180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:45.701524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:45.701964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:45.702723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:45.703150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:45.829599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:45.837390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bab7895e-ad3b-49b4-9314-b1206c97af42 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146498 Nov 09 05:13:45.837955 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 713/1445] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:45 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:46.856421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:46.856942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:46.863097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:46.863544 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:46.864464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:46.864897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:46.990330 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:46.998423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3519bce3-41bf-48d7-8e05-7a98970b7397 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145855 Nov 09 05:13:46.998986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 733/1446] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:46 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:48.014650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:48.016551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:48.023279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:48.023757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:48.024523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:48.024960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:48.153869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:48.161455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e9adad12-ac3c-4fc9-8e09-9eb59694b94a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151071 Nov 09 05:13:48.162014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 714/1447] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:49.177942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:49.178548 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:49.185889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:49.186576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:49.187358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:49.187882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:49.323394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:49.331457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3f1ae22b-68ee-48c6-b197-2743a6b3a7d9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157217 Nov 09 05:13:49.332048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 734/1448] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:49 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:13:50.348166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:50.348772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:50.355202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:50.355675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:50.356512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:50.357004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:50.485066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:50.492794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-52ac2722-a078-4c03-8622-4faf62923a33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148438 Nov 09 05:13:50.493344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 715/1449] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:50 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:51.509443 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:51.510045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:51.516660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:51.517353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:51.518119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:51.518565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:51.650321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:51.658850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-18fa64a7-9505-4b8f-b6c8-3dd4d9ba644b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153054 Nov 09 05:13:51.659428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 735/1450] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:52.675375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:52.675965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:52.682114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:52.682553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:52.683307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:52.683759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:52.812097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:52.819801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-52bc0746-e6eb-4ca2-8d9d-6f26b4dc48bb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148080 Nov 09 05:13:52.820362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 716/1451] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:52 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:53.836206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:53.836817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:53.843602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:53.844078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:53.844853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:53.845285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:53.972208 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:53.979866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e4fb279e-8e9e-46ac-9601-b629d1b4db8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147268 Nov 09 05:13:53.980425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 736/1452] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:53 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:54.995523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:54.996615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:55.002801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:55.003251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:55.004054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:55.004484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:55.147004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:55.155089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4a1b6d26-fee5-4592-9331-90ad3eda672e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.163244 Nov 09 05:13:55.155772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 717/1453] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:54 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:56.172587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:56.173121 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:56.179340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:56.179825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:56.180600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:56.181034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:56.310791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:56.318471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-582009d0-e6d7-427d-a68e-6d80af54d905 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149682 Nov 09 05:13:56.319038 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 737/1454] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:57.337645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:57.338189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:57.344405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:57.344841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:57.345592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:57.346013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:57.470814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:57.478378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-22fcd977-bf27-4681-b268-0975139a3ac1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146854 Nov 09 05:13:57.478939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 718/1455] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:57 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:58.495424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:58.496643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:58.502848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:58.503291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:58.504100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:58.504526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:58.630200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:58.638524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0801ef0b-7488-4be4-a67f-b1d243bb87b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146812 Nov 09 05:13:58.639084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 738/1456] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:58 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:13:59.655887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:13:59.656487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:13:59.662747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:59.663415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:59.664283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:13:59.664907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:13:59.796602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:13:59.804217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-746e2c69-43f4-4609-8cda-d09674193ca2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152497 Nov 09 05:13:59.804774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 719/1457] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:13:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:00.821183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:00.821786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:00.828451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:00.828892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:00.829656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:00.830088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:00.961441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:00.969639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dd1c03b7-20d9-45b9-94d4-f2176f1505d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152061 Nov 09 05:14:00.970196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 739/1458] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:00 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:01.985896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:01.986507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:01.992785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:01.993166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:01.993941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:01.994398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:02.121776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:02.129556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-75e5fe81-8eeb-491d-8150-d3c4ce7866dc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147383 Nov 09 05:14:02.130126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 720/1459] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:03.146752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:03.147357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:03.153712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:03.154160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:03.154962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:03.155394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:03.282948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:03.290628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-289f1110-86a1-476b-afec-d42d2bbdf99f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147590 Nov 09 05:14:03.291192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 740/1460] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:04.307020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:04.307646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:04.313938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:04.314384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:04.315153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:04.315588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:04.450759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:04.458504 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f4faaa50-7fb3-4c10-ac58-83acf71e02b3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155111 Nov 09 05:14:04.459071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 721/1461] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:04 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:05.149198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:05.149700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:05.155477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:05.155966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:05.156737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:05.157169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:05.181001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:14:05.253372 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2a296a7a-a18b-46e9-8c82-3b0ab0996384 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 204 len: 0 microversion: 2.20 time: 0.107663 Nov 09 05:14:05.254139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 741/1462] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 9 05:14:05 2021] DELETE /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 05:14:05.263459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:05.264088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:05.270148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:05.270595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:05.271363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:05.271867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:05.398439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:05.406591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:05.408098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:05.409226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aef0043e-8c7a-4158-b640-607cf86ec62a tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1724 microversion: 2.20 time: 0.150749 Nov 09 05:14:05.409775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 722/1463] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:14:05 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:14:05.476088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:05.476776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:05.483148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:05.483587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:05.484369 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:05.484797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:05.621347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:05.629186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e9e4741f-f96f-49df-8342-9adc7250f768 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157077 Nov 09 05:14:05.629755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 742/1464] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:05 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:06.428375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:06.428970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:06.435254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:06.435722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:06.436493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:06.436929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:06.564665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:06.572786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:06.574874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '115a975a272c4ad9a5e93a38ee1c8180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df921510edf34ac09f5be957837f5546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:06.576256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6aca84ae-8092-4947-8d42-1e713cf815c4 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 200 len: 1724 microversion: 2.20 time: 0.151772 Nov 09 05:14:06.576900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 723/1465] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:14:06 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 05:14:06.647016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:06.647803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:06.654368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:06.654899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:06.655585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:06.656077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:06.843898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:06.851651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-95757fea-6d61-421b-810e-d8a64e441398 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.208618 Nov 09 05:14:06.852290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 743/1466] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:07.084313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-47478e0a-1bd7-434d-9ce9-cddb791456d4 req-d9a5cd86-92f2-4882-af18-2cdd07db740e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6308e5b8-e07c-479a-abf3-726c34bb3ab9", "name": "network-vif-deleted", "tag": "7cc6de73-4344-46a6-af37-6e01f08a188d"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:14:07.085865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:14:07.085865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:14:07.093115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-47478e0a-1bd7-434d-9ce9-cddb791456d4 req-d9a5cd86-92f2-4882-af18-2cdd07db740e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:07.093729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-47478e0a-1bd7-434d-9ce9-cddb791456d4 req-d9a5cd86-92f2-4882-af18-2cdd07db740e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:07.114965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-47478e0a-1bd7-434d-9ce9-cddb791456d4 req-d9a5cd86-92f2-4882-af18-2cdd07db740e service nova] Creating event network-vif-deleted:7cc6de73-4344-46a6-af37-6e01f08a188d for instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 on hv-cinder-81713 Nov 09 05:14:07.121825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-47478e0a-1bd7-434d-9ce9-cddb791456d4 req-d9a5cd86-92f2-4882-af18-2cdd07db740e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119015 Nov 09 05:14:07.122984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 724/1467] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:14:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:14:07.594737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:07.595656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:07.601586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:07.602039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:07.602809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:07.603242 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:07.617006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] HTTP exception thrown: Instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 could not be found. Nov 09 05:14:07.617594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Returning 404 to user: Instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:14:07.618489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0f228f4b-bd03-480a-8085-b92a2d8369eb tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 404 len: 111 microversion: 2.20 time: 0.027470 Nov 09 05:14:07.618942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 744/1468] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 9 05:14:07 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 09 05:14:07.628799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2b804151-3db6-4d4a-8e32-2cff9e8bdb6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '.version_select at 0x7f30cc8770d0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:07.649849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2b804151-3db6-4d4a-8e32-2cff9e8bdb6c tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892777659" status: 204 len: 0 microversion: 2.20 time: 0.025581 Nov 09 05:14:07.650423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 725/1469] 10.222.0.41 () {60 vars in 1258 bytes} [Tue Nov 9 05:14:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892777659 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 05:14:07.869432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:07.870733 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:07.877037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:07.877483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:07.878286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:07.878722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:08.037849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:08.046340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a72881f3-9e6b-4325-b158-e1c7ac1c2d8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.180868 Nov 09 05:14:08.047136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 745/1470] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:07 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:09.064126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:09.064844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:09.071376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:09.071854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:09.072615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:09.073044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:09.200112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:09.208760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ba757dc1-2cf3-4c7a-b52b-f7f2a1486683 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148825 Nov 09 05:14:09.209328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 726/1471] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:10.225884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:10.226497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:10.233614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:10.234023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:10.234802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:10.235243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:10.363485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:10.371231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7e3fe04a-4b67-4c30-bb39-e9f058bf2136 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149092 Nov 09 05:14:10.371847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 746/1472] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:10 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:11.388031 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:11.388634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:11.395168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:11.395611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:11.396396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:11.396823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:11.523843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:11.532030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-db4292da-1ce9-446a-9309-763a43fd13a3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147672 Nov 09 05:14:11.532596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 727/1473] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:11 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:12.548958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:12.549718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:12.556130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:12.556574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:12.557354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:12.557788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:12.689227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:12.697274 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a7371272-4167-4fd6-b656-263500bd3a89 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151966 Nov 09 05:14:12.697985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 747/1474] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:12 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:13.713717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:13.714457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:13.720909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:13.721360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:13.722134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:13.722568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:13.849882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:13.857446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-491fa7db-1263-425f-a8ba-697b3d5a268b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147398 Nov 09 05:14:13.858011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 728/1475] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:13 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:14.873959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:14.874576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:14.880915 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:14.881362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:14.882143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:14.882579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:15.013669 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:15.021700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2d45f234-937d-4fe2-9c55-887e7195a394 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151425 Nov 09 05:14:15.022269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 748/1476] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:14 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:16.038674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:16.039279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:16.045644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:16.046123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:16.046893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:16.047320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:16.172586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:16.180309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-974fa95a-9e7f-4574-84b6-6434c709add6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145408 Nov 09 05:14:16.180873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 729/1477] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:16 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:17.197100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:17.197717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:17.204570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:17.205018 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:17.205792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:17.206225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:17.334703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:17.342984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bc93a714-459b-4fa8-85d7-3dcc8c94fb0b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149584 Nov 09 05:14:17.343652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 749/1478] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:17 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:18.365837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:18.366450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:18.372863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:18.373299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:18.374089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:18.374511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:18.506596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:18.514767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-116ed262-1b01-4e80-9505-0aed68ca7b5e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157804 Nov 09 05:14:18.515331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 730/1479] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:18 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:14:19.530719 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:19.531331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:19.537537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:19.537986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:19.538758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:19.539193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:19.669423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:19.677166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9b86b994-135f-4f2f-b527-33ab465a4330 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150161 Nov 09 05:14:19.677727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 750/1480] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:19 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:20.697551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:20.698095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:20.704978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:20.705427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:20.706194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:20.706630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:20.836555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:20.844290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8a9b7d8a-0570-431f-9f58-d6caa059945d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150553 Nov 09 05:14:20.844849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 731/1481] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:20 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:21.861238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:21.861872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:21.868215 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:21.868666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:21.869449 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:21.869876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:21.996127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:22.008269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6e2596fe-f957-4c85-8746-97291b0c3eb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148507 Nov 09 05:14:22.008844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 751/1482] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:21 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:23.025539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:23.026139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:23.034373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:23.034804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:23.035567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:23.036018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:23.163809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:23.171925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fc58cc49-6e63-4ea1-a700-1f4a397f2050 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149960 Nov 09 05:14:23.172478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 732/1483] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:23 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:24.188320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:24.188925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:24.195111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:24.195556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:24.196360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:24.196796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:24.322729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:24.330384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8747a251-6eef-4393-8327-b83264115a3d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145719 Nov 09 05:14:24.330948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 752/1484] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:24 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:25.347855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:25.348454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:25.355154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:25.355590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:25.356362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:25.356787 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:25.490953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:25.498565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-57577bce-d698-417c-9ca4-fd85f911e63e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.154594 Nov 09 05:14:25.499127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 733/1485] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:25 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:14:26.515855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:26.516393 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:26.523057 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:26.523497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:26.524293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:26.524728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:26.656399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:26.664583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4e7e3535-47c3-4c4e-be2a-6c74af082897 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152387 Nov 09 05:14:26.665178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 753/1486] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:26 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:14:27.682095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:27.682695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:27.688948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:27.689390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:27.690158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:27.690590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:27.816837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:27.825125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f3a5699c-8ea6-44ab-a158-b49a2886a1f3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146672 Nov 09 05:14:27.825634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 734/1487] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:27 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:28.841717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:28.842246 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:28.848530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:28.848972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:28.849732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:28.850154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:28.976234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:28.984630 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3a2a8803-e3a0-4830-9b65-32e86a2724fd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146648 Nov 09 05:14:28.985210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 754/1488] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:28 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:30.001655 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:30.002259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:30.008539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:30.008987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:30.009748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:30.010173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:30.140558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:30.148461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cf8f1b1e-39c6-43cd-9336-02cb7b1ac737 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150513 Nov 09 05:14:30.149022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 735/1489] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:29 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:31.165822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:31.166431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:31.173212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:31.173657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:31.174433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:31.174862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:31.306638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:31.314534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3c014605-36aa-4ec7-a124-645d9cbbb5e2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152471 Nov 09 05:14:31.315185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 755/1490] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:31 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:32.331705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:32.332138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:32.338516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:32.338952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:32.340387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:32.340814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:32.469439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:32.477171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bfbd023f-97e2-44ce-bc7d-bca65219fd00 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149338 Nov 09 05:14:32.477763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 736/1491] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:32 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:33.493867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:33.494477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:33.500717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:33.501169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:33.501942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:33.502378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:33.632395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:33.640097 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e6a11aa5-9da9-48d4-bb8d-cffea578c970 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149882 Nov 09 05:14:33.640663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 756/1492] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:33 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:34.657350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:34.657950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:34.664218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:34.664602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:34.665366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:34.665795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:34.795806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:34.803425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8a210a06-a6e8-4c4c-8e53-b007cd637a8c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149683 Nov 09 05:14:34.804020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 737/1493] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:34 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:35.820497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:35.821043 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:35.826745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:35.827193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:35.828005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:35.828439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:35.956204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:35.963887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2fcff228-5fd9-4fe2-b899-ac0e50aa400c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147220 Nov 09 05:14:35.964465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 757/1494] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:35 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:36.981545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:36.985509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:36.988633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:36.989070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:36.989825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:36.990246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:37.115904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:37.123643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3bb0e7a4-e10d-46c5-9f5b-df7d4cacce37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146796 Nov 09 05:14:37.124198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 738/1495] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:36 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:38.139939 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:38.140568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:38.147104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:38.147546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:38.148354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:38.148786 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:38.274720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:38.282407 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-48303c0f-2284-4998-ac91-1ae72a9f1212 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146196 Nov 09 05:14:38.282966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 758/1496] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:38 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:39.298629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:39.299233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:39.305537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:39.305979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:39.306745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:39.307173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:39.442700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:39.450986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ccc294fd-1b63-456e-bfcf-b14df3200bd1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.156005 Nov 09 05:14:39.451548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 739/1497] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:39 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:40.468207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:40.468810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:40.475234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:40.475745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:40.476530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:40.476962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:40.604070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:40.611901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8f259ccb-2da3-46eb-a7ee-4fa2ceccf508 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148028 Nov 09 05:14:40.612473 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 759/1498] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:40 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:41.629201 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:41.629804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:41.636126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:41.636566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:41.637327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:41.637749 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:42.002874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:42.012784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-350c3495-4e35-4bca-8b32-1ec42fef0a06 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.387217 Nov 09 05:14:42.013518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 740/1499] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:41 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:43.030288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:43.030926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:43.037157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:43.037602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:43.038382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:43.038812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:43.168237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:43.175884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b7d73a58-b414-4c18-b0d9-ee983f662166 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149713 Nov 09 05:14:43.176457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 760/1500] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:43 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:44.192409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:44.193008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:44.199827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:44.200268 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:44.201026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:44.201451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:44.325814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:44.333418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-259f9ffe-7e90-47cb-b4fa-1f74ee2017c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144650 Nov 09 05:14:44.333984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 741/1501] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:14:45.350656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:45.351192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:45.358086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:45.358540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:45.359319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:45.359793 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:45.485072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:45.492818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d64ddbd0-def4-4a23-973c-52b0228eb7e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146038 Nov 09 05:14:45.493384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 761/1502] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:45 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:46.509494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:46.510091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:46.517088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:46.517525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:46.518277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:46.518703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:46.648144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:46.655830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ed2904f5-b868-49f3-9505-cd60aa2cebed tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150023 Nov 09 05:14:46.656397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 742/1503] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:46 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:47.673423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:47.674019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:47.680296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:47.680739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:47.681503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:47.681958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:47.809729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:47.817454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e6574070-9b5e-44dd-b577-c7ed93be3831 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147695 Nov 09 05:14:47.818019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 762/1504] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:47 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:48.833864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:48.834429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:48.841161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:48.841600 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:48.842357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:48.842785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:48.966784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:48.974380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3ffd2cbe-ff97-419d-bcea-d3dd7966811c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144305 Nov 09 05:14:48.974942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 743/1505] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:49.991549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:49.992200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:49.998431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:49.998879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:49.999728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:50.000172 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:50.126850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:50.134776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-37f2dd1d-0895-4e67-8490-b08d964da28f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147028 Nov 09 05:14:50.135355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 763/1506] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:49 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:51.152691 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:51.153295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:51.159456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:51.159917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:51.160671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:51.161102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:51.292608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:51.301741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2d79fb14-f2ef-4593-9ce8-6f53a741a9d1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153059 Nov 09 05:14:51.302467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 744/1507] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:51.615589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:14:51.615822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:14:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:14:52.317834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:52.318440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:52.324585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:52.325024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:52.325785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:52.326213 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:52.451376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:52.459850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-606afbdb-972e-40b6-8bdc-797f8d14b32d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145524 Nov 09 05:14:52.460570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 764/1508] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:52 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:53.476309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:53.476950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:53.483692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:53.484139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:53.484907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:53.485337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:53.617520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:53.625293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a6da1da1-f546-4ab6-b09c-b1a408f15ae4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152612 Nov 09 05:14:53.625860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 745/1509] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:53 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:54.642096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:54.642701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:54.648949 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:54.649401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:54.650180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:54.650622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:54.781934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:54.789662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0abf49c5-fca4-466a-9b1e-5d5bcf1c13e4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151465 Nov 09 05:14:54.790236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 765/1510] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:54 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:55.806331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:55.806975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:55.813099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:55.813537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:55.814295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:55.814715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:55.938032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:55.945581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9ac974d8-0aea-4586-829c-0eeae09da9ad tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.143166 Nov 09 05:14:55.946140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 746/1511] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:55 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:56.962176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:56.962711 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:56.969587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:56.970030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:56.970799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:56.971232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:57.105466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:57.113267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f0161f1a-8893-42c7-a007-445311f1963a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.154854 Nov 09 05:14:57.113829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 766/1512] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:57.734371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:57.734866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:57.741067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:57.741506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:57.742269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:57.742742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:57.767184 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:14:57.838353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e6a9c83f-d6cf-429c-b3a6-900764d1450e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 204 len: 0 microversion: 2.1 time: 0.107327 Nov 09 05:14:57.839473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 747/1513] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:14:57 2021] DELETE /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:14:57.847745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:57.848379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:57.854340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:57.854783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:57.855555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:57.856019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:57.987103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:57.994519 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b131ed63-9ede-46d6-97fe-38c0ed3c72dc tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1675 microversion: 2.1 time: 0.150494 Nov 09 05:14:57.995015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 767/1514] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:57 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:14:58.130621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:58.131302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:58.137762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:58.138199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:58.138953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:58.139376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:58.270365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:58.278082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-664da5e0-78ae-4b89-ab83-b9995b5e584a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151543 Nov 09 05:14:58.278646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 748/1515] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:58 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:59.012236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:59.012861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:59.019218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:59.019698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:59.020476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:59.020904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:59.225593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:59.233688 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3fe0de9c-4329-44c3-8632-8c891a1fe18a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1675 microversion: 2.1 time: 0.225783 Nov 09 05:14:59.234613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 768/1516] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:59 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:59.294834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:14:59.295528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:14:59.301959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:59.302403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:59.303173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:59.303599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:59.429921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:14:59.437572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d723f224-4402-4e6a-b5c5-523862d1d37e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146980 Nov 09 05:14:59.438132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 749/1517] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:14:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:14:59.779087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-b5b1eb0e-450f-4307-93fe-89cb315f6b15 req-d7a779d5-54ef-41c1-92b5-716bacb4834b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4805f839-96d2-42b9-8e81-1ebd537fdc33", "name": "network-vif-deleted", "tag": "508ee994-7191-4353-818e-c88d4f711451"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:14:59.781242 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:14:59.781242 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:14:59.793902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b5b1eb0e-450f-4307-93fe-89cb315f6b15 req-d7a779d5-54ef-41c1-92b5-716bacb4834b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:14:59.793902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b5b1eb0e-450f-4307-93fe-89cb315f6b15 req-d7a779d5-54ef-41c1-92b5-716bacb4834b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:14:59.800700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-b5b1eb0e-450f-4307-93fe-89cb315f6b15 req-d7a779d5-54ef-41c1-92b5-716bacb4834b service nova] Creating event network-vif-deleted:508ee994-7191-4353-818e-c88d4f711451 for instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 on hv-cinder-81713 Nov 09 05:14:59.808002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-b5b1eb0e-450f-4307-93fe-89cb315f6b15 req-d7a779d5-54ef-41c1-92b5-716bacb4834b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Nov 09 05:14:59.809003 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 769/1518] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:14:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:15:00.250908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:00.251828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:00.258061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:00.258498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:00.259431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:00.259895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:00.296422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:00.297188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:00.297774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lazy-loading 'fault' on Instance uuid 4805f839-96d2-42b9-8e81-1ebd537fdc33 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:15:00.341671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d92b2e7b1b46f6916c335b25a44ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf465ea6c244dcaa76ca3817fc6801f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:00.348279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0f35c121-9f66-4bf0-84e8-5f20f9158810 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 200 len: 1327 microversion: 2.1 time: 0.101453 Nov 09 05:15:00.349197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 750/1519] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:00 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:00.455207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:00.455934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:00.461855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:00.462307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:00.463081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:00.464143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:00.598064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:00.605846 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-54d757b3-ffae-4b23-afb1-fa5fdf512937 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155257 Nov 09 05:15:00.606400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 770/1520] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:00 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:01.365650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:01.366244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:01.372520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:01.372958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:01.373711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:01.374134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:01.387524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] HTTP exception thrown: Instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 could not be found. Nov 09 05:15:01.388147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Returning 404 to user: Instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:15:01.388943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e5c61657-e116-4e08-9c84-357cac0a733a tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 404 len: 111 microversion: 2.1 time: 0.027124 Nov 09 05:15:01.389448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 751/1521] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:01 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:15:01.397626 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9a2fcb96-02d1-4260-81b4-4a8edfc2cf82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '.version_select at 0x7f30cca684c0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:01.418537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9a2fcb96-02d1-4260-81b4-4a8edfc2cf82 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025947826" status: 202 len: 0 microversion: 2.1 time: 0.024526 Nov 09 05:15:01.419104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 771/1522] 10.222.0.41 () {58 vars in 1220 bytes} [Tue Nov 9 05:15:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025947826 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:15:01.622657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:01.623179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:01.629071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:01.629521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:01.630284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:01.630714 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:01.825658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:01.833423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ca30d2c1-c50b-4a2e-b8ef-24d9785f37e3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.215031 Nov 09 05:15:01.833997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 752/1523] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:02.850117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:02.850747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:02.857446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:02.857914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:02.858682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:02.859108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:02.989365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:02.998029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e2def9f4-ff8f-41e6-9031-d87ac954ec14 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151598 Nov 09 05:15:02.998582 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 772/1524] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:02 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:04.014247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:04.014850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:04.021235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:04.021674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:04.022467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:04.022892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:04.154307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:04.161978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f1ef3778-9757-40ae-b7a6-ffa7f0ed0a0e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151844 Nov 09 05:15:04.162540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 753/1525] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:04 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:05.178657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:05.179263 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:05.185196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:05.185635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:05.186396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:05.186827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:05.311829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:05.319370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-42cd2cf5-0de3-4c79-ace9-57b17549d78d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144350 Nov 09 05:15:05.319961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 773/1526] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:05 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:06.337030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:06.337548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:06.343864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:06.344309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:06.345075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:06.345503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:06.472747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:06.481046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-629807bc-1bc2-4f55-8509-bec762f89948 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147813 Nov 09 05:15:06.481608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 754/1527] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:07.497428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:07.498026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:07.504186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:07.504653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:07.505414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:07.505841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:07.636558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:07.644502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dd3ffa78-c1a5-4e6a-b20e-df9627dfe7dd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150728 Nov 09 05:15:07.645068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 774/1528] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:07 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:08.662217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:08.662810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:08.669612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:08.670047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:08.670804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:08.671227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:08.799234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:08.806920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8bd2557b-f488-41af-9e3e-1e547d3a4693 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148377 Nov 09 05:15:08.807479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 755/1529] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:08 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:09.824198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:09.824719 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:09.830917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:09.831359 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:09.832146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:09.832575 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:09.958660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:09.966523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-efc9403f-bb1e-46f8-ba51-d7bcdaee071b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146601 Nov 09 05:15:09.967086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 775/1530] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:10.984000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:10.984602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:10.990781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:10.991228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:10.992015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:10.992445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:11.117994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:11.126356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-61162490-5a50-4fa4-947a-233364df511a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146011 Nov 09 05:15:11.126918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 756/1531] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:10 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:12.143255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:12.143945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:12.150132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:12.151072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:12.151861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:12.152290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:12.278096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:12.285843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e5eec784-02d1-4c8c-b552-f835bbedb1e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146578 Nov 09 05:15:12.286410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 776/1532] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:12 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:13.302654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:13.303251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:13.310021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:13.310461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:13.311217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:13.311663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:13.438924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:13.446594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6e8e168c-c8eb-4cb9-97bd-f529d65b551d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147553 Nov 09 05:15:13.447147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 757/1533] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:13 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:14.463495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:14.464139 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:14.470345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:14.470878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:14.471687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:14.472133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:14.601345 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:14.610154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7d5bb305-16b9-4dbc-af65-f0e9c7c0043d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150773 Nov 09 05:15:14.610721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 777/1534] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:14 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:15.626907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:15.628636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:15.635770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:15.636451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:15.637331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:15.637766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:15.767317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:15.775327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0a012fec-2862-45c1-91b3-0addcc6292f6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151997 Nov 09 05:15:15.776669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 758/1535] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:15 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:16.792893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:16.793454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:16.799834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:16.800289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:16.801065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:16.801510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:16.927689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:16.935905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0374f7d1-bcc4-4c7d-bbbf-6bae87b580c5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146852 Nov 09 05:15:16.936472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 778/1536] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:16 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:17.952312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:17.952942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:17.959307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:17.959794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:17.960570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:17.961005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:18.087042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:18.094680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b722ba24-4b07-4282-9a69-9e31847ecd17 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146056 Nov 09 05:15:18.095234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 759/1537] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:17 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:19.111555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:19.112194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:19.118412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:19.118834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:19.119596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:19.120043 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:19.249643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:19.257415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-54be2485-fef1-4da6-8b8b-4ba6aff4ba2e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149558 Nov 09 05:15:19.257974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 779/1538] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:19 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:20.274814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:20.275362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:20.281563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:20.282001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:20.282756 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:20.283179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:20.412061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:20.420337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-612c7d02-9278-447c-9391-c5468f0d3b59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149306 Nov 09 05:15:20.420893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 760/1539] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:20 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:21.436979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:21.437587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:21.443541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:21.444063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:21.444778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:21.445241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:21.570317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:21.578597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed68cdc0-06da-4722-92ad-a7320f889b27 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145335 Nov 09 05:15:21.579154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 780/1540] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:21 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:22.595782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:22.596379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:22.602554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:22.602993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:22.603781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:22.604205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:22.731151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:22.738963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ece9d3a9-27f9-4431-9ca1-86c9d688436a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146899 Nov 09 05:15:22.739529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 761/1541] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:22 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:23.755742 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:23.756349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:23.762977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:23.763426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:23.764218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:23.764646 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:23.892386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:23.900077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-56ee5e8f-1404-426e-92a5-514732de9090 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148004 Nov 09 05:15:23.900642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 781/1542] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:23 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:24.917005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:24.917607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:24.923921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:24.924371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:24.925140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:24.925579 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:25.050508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:25.058653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7422496c-8282-46b7-8e97-0be68930fa77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145282 Nov 09 05:15:25.059241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 762/1543] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:24 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:26.075614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:26.076325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:26.082438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:26.082883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:26.083692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:26.084133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:26.214180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:26.221810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f1579b15-3118-4e49-a4a3-d1464583a031 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150339 Nov 09 05:15:26.222370 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 782/1544] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:26 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:27.239060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:27.239580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:27.245925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:27.246368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:27.247128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:27.247558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:27.375741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:27.383511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fc2502db-ff7b-4db2-87ff-65100295c0cd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148269 Nov 09 05:15:27.384112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 763/1545] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:27 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:28.401229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:28.401825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:28.408104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:28.408550 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:28.409318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:28.409747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:28.535549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:28.543212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-347b15a9-6101-4ebe-a152-b0bfb8955e9d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146430 Nov 09 05:15:28.543804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 783/1546] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:28 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:29.559679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:29.560293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:29.566580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:29.567022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:29.567848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:29.568275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:29.694705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:29.703264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a10099d6-233c-4d7d-b2e4-f8e38ff3b7c9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147246 Nov 09 05:15:29.703900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 764/1547] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:29 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:30.719864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:30.720467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:30.726591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:30.727031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:30.727829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:30.728257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:30.857379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:30.864976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bef0a8f5-9b23-450d-bc13-f8b5548af50b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148742 Nov 09 05:15:30.865541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 784/1548] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:30 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:31.881971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:31.882596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:31.889009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:31.889446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:31.890207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:31.890630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:32.021217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:32.028933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-701b7d2e-6462-434f-8301-5ad609d6864b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150580 Nov 09 05:15:32.029503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 765/1549] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:31 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:33.046379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:33.046986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:33.053212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:33.053656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:33.054424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:33.054856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:33.183273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:33.191091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-69fcded7-b12d-4180-ac25-7681fee45118 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148389 Nov 09 05:15:33.191670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 785/1550] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:33 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:15:34.207342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:34.207969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:34.214208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:34.214652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:34.215422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:34.215871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:34.348185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:34.356468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f59b4caf-0ee6-4836-9f5d-31ce19655d7a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152842 Nov 09 05:15:34.357027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 766/1551] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:34 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:35.374543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:35.375143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:35.381159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:35.381594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:35.382354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:35.382781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:35.517020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:35.525115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c227579-afb7-4746-ac0d-e83292777a6a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.154778 Nov 09 05:15:35.525618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 786/1552] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:35 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:36.541566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:36.542163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:36.548113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:36.548554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:36.549317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:36.549747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:36.682602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:36.690372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0e22cc3e-342b-47cb-bcfb-8e8d682dfc01 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152993 Nov 09 05:15:36.690964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 767/1553] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:36 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:37.706904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:37.707506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:37.714278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:37.714724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:37.715492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:37.715953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:37.842752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:37.850482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8a61edd7-ed93-4cb1-8ebc-f54cdf6dd35f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147275 Nov 09 05:15:37.851053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 787/1554] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:37 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:38.868018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:38.868643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:38.874843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:38.875277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:38.876104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:38.876528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:39.002730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:39.010936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ab24d203-709e-494c-a722-8ab4e9a146e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146612 Nov 09 05:15:39.011488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 768/1555] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:38 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:40.028113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:40.028708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:40.034867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:40.035310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:40.036104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:40.036531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:40.162755 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:40.171012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-aaa9345b-a9aa-46fb-86a9-7fd3d870ad77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147060 Nov 09 05:15:40.171574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 788/1556] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:40 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:41.187815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:41.188433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:41.194672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:41.195111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:41.195899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:41.196325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:41.327074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:41.334765 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8dc34b6b-dce5-417b-9756-1a45ce99bf8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150634 Nov 09 05:15:41.335332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 769/1557] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:41 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:42.353752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:42.354643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:42.361297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:42.361734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:42.362497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:42.362921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:42.495897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:42.503551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b388fbcf-5c7a-4c55-be13-30dc254d928d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.154330 Nov 09 05:15:42.504142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 789/1558] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:42 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:43.521623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:43.522205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:43.528420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:43.528913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:43.529670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:43.530092 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:43.660233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:43.667962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ffdc3362-eb74-4123-aecf-6ef16b26540c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149972 Nov 09 05:15:43.668525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 770/1559] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:43 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:44.685107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:44.685742 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:44.692007 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:44.692445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:44.693204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:44.693631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:44.821799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:44.829531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dcb2cd0e-300d-4b16-99f8-2e777cfb8580 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148599 Nov 09 05:15:44.830112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 790/1560] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:45.845839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:45.846481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:45.853151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:45.853601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:45.854367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:45.854796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:45.981544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:45.989337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-08d72c82-4999-4ec2-8565-57ff76c20b37 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147083 Nov 09 05:15:45.989910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 771/1561] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:45 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:47.005841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:47.006441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:47.013266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:47.013706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:47.014466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:47.014894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:47.147363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:47.155174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9da9a7c4-a3d9-4e55-887d-b16d4e6ad8b4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153018 Nov 09 05:15:47.155756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 791/1562] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:47 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:48.171588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:48.172216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:48.178476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:48.178920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:48.179711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:48.180142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:48.309138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:48.316822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d077f243-e049-46c1-a656-40150740b617 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148967 Nov 09 05:15:48.317387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 772/1563] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:49.333153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:49.333753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:49.340492 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:49.340936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:49.341701 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:49.342133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:49.472674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:49.480364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-643c5f55-4a83-4378-8e3d-d949b4b2d19b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150833 Nov 09 05:15:49.480930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 792/1564] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:49 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:50.496950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:50.497552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:50.503875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:50.504319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:50.505086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:50.505514 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:50.632380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:50.640166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9bf79afb-8db6-4b29-a881-4579b157ad73 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146881 Nov 09 05:15:50.641001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 773/1565] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:50 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:51.657555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:51.658173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:51.664568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:51.665021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:51.665802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:51.666234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:51.796631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:51.804392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-de967aac-1aa7-40fc-8659-f813df83b760 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150661 Nov 09 05:15:51.804966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 793/1566] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:52.820941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:52.821558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:52.828371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:52.828808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:52.829560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:52.829982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:52.954449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:52.962129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9047d7f0-f6ad-4b99-afe9-ccf3cd18683e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144855 Nov 09 05:15:52.962695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 774/1567] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:52 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:53.979232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:53.979858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:53.986024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:53.986464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:53.987236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:53.987686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:54.116747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:54.124423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4b09e6eb-124a-4646-a3f2-a55686cf8559 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149352 Nov 09 05:15:54.124993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 794/1568] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:53 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:55.141764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:55.142346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:55.148571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:55.149017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:55.149778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:55.150211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:55.280930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:55.288836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dd75c5a1-14b1-4c94-893d-a7ffabd52335 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151064 Nov 09 05:15:55.289399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 775/1569] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:55 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:56.305109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:56.305717 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:56.312667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:56.313119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:56.313913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:56.314512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:56.503444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:56.511141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1dc7eb1b-5f04-4144-8b98-97ed5c6f6647 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.209656 Nov 09 05:15:56.511729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 795/1570] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:57.527937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:57.528539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:57.534718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:57.535155 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:57.535944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:57.536368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:57.665792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:57.674216 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3eeb8ce5-ee9f-4944-b359-ba7c48343799 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149904 Nov 09 05:15:57.674789 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 776/1571] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:57 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:58.691418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:58.692195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:58.699067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:58.699505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:58.700299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:58.700725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:58.832123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:15:58.839856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7f38086a-3978-46d0-8381-7cfbf18e3839 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152160 Nov 09 05:15:58.840421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 796/1572] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:58 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:15:59.855836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:15:59.856431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:15:59.862852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:59.863405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:59.864197 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:15:59.864629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:15:59.993220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:00.001432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d93f0426-855b-46d7-804f-d4ebecd58be6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149274 Nov 09 05:16:00.001989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 777/1573] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:15:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:01.018660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:01.019216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:01.025453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:01.025893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:01.026658 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:01.027087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:01.153251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:01.160960 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fab8ec72-633e-49bb-89d0-20361e2b516c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146293 Nov 09 05:16:01.161524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 797/1574] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:02.177825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:02.178455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:02.185265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:02.185706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:02.186470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:02.186898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:02.312142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:02.319855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a0d2b9fd-1abb-4ac9-9168-5cf194c49044 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145646 Nov 09 05:16:02.320420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 778/1575] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:02 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:03.336532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:03.337141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:03.343887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:03.344331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:03.345103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:03.345536 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:03.474551 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:03.482842 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-de144cee-929c-4336-8dda-9c986669a37c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150008 Nov 09 05:16:03.483403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 798/1576] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:16:04.499375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:04.499998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:04.506174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:04.506608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:04.507390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:04.507852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:04.637591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:04.645573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-969ad817-09a3-47fb-b5ea-61e033ca916e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149873 Nov 09 05:16:04.646139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 779/1577] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:04 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:05.662708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:05.663313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:05.669146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:05.669594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:05.670366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:05.670797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:05.808611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:05.816522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cda91cb0-ac5b-4f24-8901-de4600c70fb8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157658 Nov 09 05:16:05.817087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 799/1578] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:05 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:06.833205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:06.833814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:06.840088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:06.840544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:06.841321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:06.841757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:06.966957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:06.974680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-56a5d2cb-829c-40fa-952f-187142b7ce15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145230 Nov 09 05:16:06.975252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 780/1579] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:07.991963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:07.992569 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:07.998837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:07.999288 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:08.000096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:08.000535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:08.127895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:08.136092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6bd35567-047b-4b01-90ea-08f00a971e7e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147775 Nov 09 05:16:08.136652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 800/1580] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:07 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:09.153262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:09.153860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:09.160022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:09.160468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:09.161224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:09.161646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:09.287901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:09.295553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e0a37b94-6dff-43d7-9220-b486222c1be8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146461 Nov 09 05:16:09.296139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 781/1581] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:10.312160 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:10.312724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:10.318824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:10.319262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:10.320047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:10.320502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:10.457250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:10.465583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-47b91860-3b60-47e2-bddf-6c19129f3e79 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157171 Nov 09 05:16:10.466130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 801/1582] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:10 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:11.482716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:11.483317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:11.489500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:11.489944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:11.490707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:11.491136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:11.620577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:11.628244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fd880308-f93f-46b3-8aef-af1c3c16d169 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149219 Nov 09 05:16:11.628810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 782/1583] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:11 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:12.645944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:12.646648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:12.654426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:12.655145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:12.656195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:12.656635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:12.793534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:12.803705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1b5b906c-e77b-47a7-b1c3-20388874eb29 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.162052 Nov 09 05:16:12.804403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 802/1584] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:12 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:13.819833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:13.820364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:13.826688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:13.827126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:13.827918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:13.828339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:13.954264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:13.961903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-36f73415-2646-43aa-9eae-d3281d50ce2b tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145762 Nov 09 05:16:13.962974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 783/1585] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:13 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:14.979996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:14.980608 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:14.986817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:14.987258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:14.988050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:14.988483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:15.117980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:15.126169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-49e81c59-96a3-4747-89f9-bc75f943e786 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150776 Nov 09 05:16:15.126746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 803/1586] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:14 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:16.143081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:16.143879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:16.150448 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:16.150884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:16.151654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:16.152082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:16.289194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:16.296796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-31bb3454-140f-4664-85b9-56d8d5702c21 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157628 Nov 09 05:16:16.297360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 784/1587] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:16 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:17.313250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:17.313858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:17.320063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:17.320515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:17.321291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:17.322237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:17.450896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:17.458791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-364cc828-7b80-4c9b-aeb7-22c871ffd532 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149176 Nov 09 05:16:17.459452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 804/1588] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:17 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:18.475301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:18.475925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:18.482616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:18.483056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:18.484230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:18.484658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:18.613025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:18.621292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5c3730d0-974d-4d21-bf84-e8163fc3ad71 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149568 Nov 09 05:16:18.621853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 785/1589] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:18 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:19.637705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:19.638311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:19.644889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:19.645326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:19.646087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:19.646516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:19.777179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:19.785655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7668e834-d284-49a2-9ca3-48f3973c8317 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152119 Nov 09 05:16:19.786253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 805/1590] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:19 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:20.802514 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:20.803063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:20.809754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:20.810196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:20.810959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:20.811387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:20.937315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:20.944988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e2c10ee0-7fbc-4069-b035-2dc35e4c7540 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146188 Nov 09 05:16:20.945549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 786/1591] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:20 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:21.961734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:21.962567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:21.969503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:21.969941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:21.970709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:21.971142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:22.096757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:22.104413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ddc50076-a409-494d-903f-81a0cca49ef1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146352 Nov 09 05:16:22.104971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 806/1592] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:21 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:23.121436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:23.122044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:23.128333 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:23.128778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:23.129549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:23.129982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:23.260168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:23.268176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d2feafd1-32b5-4ea6-a84c-443af23bcd30 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150512 Nov 09 05:16:23.268742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 787/1593] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:23 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:24.285267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:24.285871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:24.292712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:24.293158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:24.293925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:24.294390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:24.419187 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:24.426851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-685a085e-e3f1-4ac2-b86f-cdab406d94a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145337 Nov 09 05:16:24.427410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 807/1594] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:24 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:25.443807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:25.444422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:25.450650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:25.451085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:25.451879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:25.452311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:25.580261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:25.588674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-74431140-854f-4519-a4d1-7677ee11f5b5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148562 Nov 09 05:16:25.589249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 788/1595] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:25 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:26.605249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:26.605860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:26.612135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:26.612584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:26.613361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:26.613795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:26.754833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:26.762577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8bc8f61c-3e99-4d7a-b1b8-4a9e870af3fc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.161029 Nov 09 05:16:26.764193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 808/1596] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:26 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:27.780123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:27.780947 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:27.787176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:27.787653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:27.788430 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:27.788859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:27.924972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:27.933288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cc2f4652-2c09-44ea-a7a0-642655ec1b15 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.156838 Nov 09 05:16:27.933855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 789/1597] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:27 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:28.950420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:28.951021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:28.957371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:28.957814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:28.958585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:28.959015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:29.088316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:29.096233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-94e1f238-f266-4c2c-9c93-2e48863d1075 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150022 Nov 09 05:16:29.096794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 809/1598] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:28 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:30.113259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:30.113888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:30.120623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:30.121065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:30.121852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:30.122291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:30.249428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:30.257053 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-853645d7-7d93-4609-9570-45c0ba8e3b95 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147444 Nov 09 05:16:30.257612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 790/1599] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:30 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:31.273855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:31.274395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:31.281186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:31.281634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:31.282398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:31.282835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:31.420210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:31.427861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-722ccfd4-2841-4ee3-a3a0-ad25ad70f8a8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157650 Nov 09 05:16:31.428428 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 810/1600] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:31 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:31.611577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:16:31.612100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:16:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:16:32.444522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:32.445125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:32.452044 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:32.452484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:32.453241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:32.453665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:32.586118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:32.594341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b866cbb0-9543-4197-921c-93d9825059e8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153587 Nov 09 05:16:32.594896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 791/1601] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:32 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:33.611029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:33.611645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:33.617948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:33.618385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:33.619145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:33.619572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:33.745598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:33.753600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f243cbe5-e6fa-4fcd-bacd-9a36d46fa5ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146223 Nov 09 05:16:33.754166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 811/1602] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:33 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:34.356974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:16:34.357135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:16:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:16:34.770908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:34.771534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:34.777742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:34.778179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:34.778932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:34.779355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:34.904307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:34.911963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6b26229b-3350-42e6-9450-e30cc4b29abb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144775 Nov 09 05:16:34.912520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 792/1603] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:34 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:35.929618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:35.930252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:35.936749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:35.937198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:35.937967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:35.938399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:36.065270 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:36.073053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-32c1167b-58f9-4b83-b0c7-71cb92591a34 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147305 Nov 09 05:16:36.073622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 812/1604] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:35 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:37.090204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:37.090805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:37.096726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:37.097164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:37.097915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:37.098334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:37.226097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:37.234447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-178d8446-acb0-4bb2-88ad-e10f23db9f87 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148411 Nov 09 05:16:37.234999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 793/1605] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:37 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:38.251313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:38.251943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:38.258113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:38.258557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:38.259905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:38.260336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:38.394243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:38.400580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1182fdf5-e9e6-4907-9d6c-f3ec121a2fdb tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152833 Nov 09 05:16:38.401144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 813/1606] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:38 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:39.417632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:39.418259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:39.424328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:39.424808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:39.425508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:39.426167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:39.558725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:39.566501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-61b6cd94-02f8-41ab-971b-3a5868015524 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152514 Nov 09 05:16:39.567261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 794/1607] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:39 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:40.584194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:40.584802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:40.591326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:40.591811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:40.592590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:40.593030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:40.721244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:40.730037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-307f3193-2a4c-4d4d-ba3a-477808824bf3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149555 Nov 09 05:16:40.730596 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 814/1608] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:40 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:41.747272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:41.747989 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:41.754298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:41.754741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:41.755500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:41.755961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:41.880461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:41.888635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-63901092-4c17-4e61-ad32-e6834c4ce304 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145699 Nov 09 05:16:41.889202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 795/1609] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:41 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:42.905904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:42.906543 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:42.912845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:42.913292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:42.914071 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:42.914503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:43.044534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:43.052296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f2da1a97-0d17-4b93-98ff-b9c9fbbfb766 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150065 Nov 09 05:16:43.052863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 815/1610] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:42 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:44.068915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:44.069545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:44.075858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:44.076301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:44.077054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:44.077480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:44.205202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:44.212890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-39018498-d704-4b87-ad59-344a1abf2fbd tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147610 Nov 09 05:16:44.213447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 796/1611] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:45.229468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:45.230074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:45.236337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:45.236788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:45.237564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:45.238002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:45.374012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:45.381819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3911d361-60dc-48f4-a821-fc3ec2645d33 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.156010 Nov 09 05:16:45.382389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 816/1612] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:45 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:46.399885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:46.400538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:46.406732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:46.407168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:46.407955 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:46.408380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:46.533613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:46.541205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-35de7b1b-2eea-4e9d-a4b3-c3c13ee371f5 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145659 Nov 09 05:16:46.541761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 797/1613] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:46 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:47.558477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:47.559109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:47.565315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:47.565753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:47.566517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:47.566942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:47.697602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:47.705261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a1859c6d-306c-4bf2-858d-5011b7cce57a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150990 Nov 09 05:16:47.705817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 817/1614] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:47 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:48.721812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:48.722416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:48.729121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:48.729557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:48.730308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:48.730731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:48.858169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:48.865950 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-895b1fbe-7cc6-4eba-9339-f0177176818c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147808 Nov 09 05:16:48.866513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 798/1615] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:49.881735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:49.882480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:49.888844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:49.889297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:49.890352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:49.890792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:50.026123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:50.033736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-791db237-f189-4562-8d06-f6446a9fd493 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155766 Nov 09 05:16:50.034286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 818/1616] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:49 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:51.049824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:51.050503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:51.057101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:51.057540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:51.058301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:51.058729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:51.190327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:51.198608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-febc0376-5751-416b-ad9e-5e8e15d9f9be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152374 Nov 09 05:16:51.199159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 799/1617] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:52.214986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:52.215594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:52.221851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:52.222467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:52.223254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:52.223720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:52.349402 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:52.357119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cfefb561-f6d6-44a4-a154-24fb90e1cb59 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146296 Nov 09 05:16:52.357683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 819/1618] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:52 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:53.373635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:53.374180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:53.380433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:53.380880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:53.381646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:53.382080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:53.512463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:53.520328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-29ce67cc-3f63-488b-8758-8730317f2cc8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150385 Nov 09 05:16:53.520895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 800/1619] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:53 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:54.537558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:54.538166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:54.544868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:54.545307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:54.546088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:54.546497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:54.676120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:54.684436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2992e2f1-a37c-43e5-b716-6840a6881654 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150539 Nov 09 05:16:54.685004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 820/1620] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:54 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:55.701385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:55.701986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:55.708239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:55.708678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:55.709441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:55.709866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:55.841510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:55.849094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5d27a03b-16e1-404c-a11b-0c0da97b60d6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151406 Nov 09 05:16:55.849665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 801/1621] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:55 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:56.866343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:56.866924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:56.873801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:56.874243 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:56.875022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:56.875451 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:57.079453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:57.087540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-97b19f3c-d4f4-4dde-9ea8-2be75dfa2fea tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.225144 Nov 09 05:16:57.088132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 821/1622] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:58.104738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:58.105317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:58.111584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:58.112055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:58.112812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:58.113238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:58.241827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:58.249469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-032c31e8-fe78-4f23-b7bb-d7ee085e378f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149053 Nov 09 05:16:58.250023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 802/1623] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:58 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:16:59.266764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:16:59.267352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:16:59.273547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:59.273995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:59.274768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:16:59.275203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:16:59.407061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:16:59.415502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4243572c-5095-43b7-b972-5655ab0b9931 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152688 Nov 09 05:16:59.416099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 822/1624] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:16:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:00.432409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:00.433116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:00.439541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:00.440012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:00.440778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:00.441202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:00.573921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:00.581668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0cfcd86a-79af-4f04-bb0a-0beaef49e7be tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153412 Nov 09 05:17:00.582230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 803/1625] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:00 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:01.598004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:01.598637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:01.605487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:01.605925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:01.606735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:01.607115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:01.736526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:01.744316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6d8e1e40-c510-461b-92fd-44d4df873caa tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149922 Nov 09 05:17:01.744880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 823/1626] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:01.869017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 09 05:17:01.869392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:17:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:17:02.760973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:02.761493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:02.768090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:02.768533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:02.769300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:02.769761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:02.894903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:02.902566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0375478a-220d-49bd-9e2a-27578daf7296 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145416 Nov 09 05:17:02.903133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 804/1627] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:02 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:03.918792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:03.919406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:03.925725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:03.926174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:03.926985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:03.927423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:04.059810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:04.067468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5823070f-f668-4b7a-814e-2d5aa200be13 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152783 Nov 09 05:17:04.068062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 824/1628] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:04.158399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:17:04.158936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:17:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:17:05.084682 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:05.085287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:05.092270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:05.092726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:05.093494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:05.093927 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:05.270993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:05.279210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-07cd2719-b7c8-4a40-b3d3-2e2d4d52e6d8 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.198238 Nov 09 05:17:05.279792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 805/1629] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:05 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:06.296032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:06.296610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:06.302440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:06.302902 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:06.303685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:06.304116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:06.481864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:06.489523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c3cb6199-e617-4ca9-aa04-521c5c102795 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.197323 Nov 09 05:17:06.490081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 825/1630] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:06 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:07.507006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:07.508357 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:07.515055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:07.515501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:07.516301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:07.516735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:07.647373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:07.655017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-16dfdac1-050d-4333-afad-a70d54c115e6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151883 Nov 09 05:17:07.655584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 806/1631] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:07 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:08.672158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:08.672764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:08.678982 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:08.679423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:08.680228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:08.680659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:08.817316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:08.825616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-015b6776-3548-4454-91c9-112e215a986a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.157116 Nov 09 05:17:08.826384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 826/1632] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:08 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:09.842770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:09.843373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:09.849106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:09.849544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:09.850406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:09.850732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:09.984959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:09.992946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dc3b4218-ab00-4232-90b0-6af18e1421e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.154259 Nov 09 05:17:09.993557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 807/1633] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:09 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:11.009616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:11.010235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:11.016721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:11.017172 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:11.017990 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:11.018435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:11.146682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:11.154498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1ef06e6d-c4f0-4e12-93cf-06135a06dbe2 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148558 Nov 09 05:17:11.155068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 827/1634] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:11 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:12.171012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:12.171535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:12.177877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:12.178327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:12.179096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:12.179530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:12.311293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:12.318952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-30a9810c-3126-4729-bd54-2acdb69893ce tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151648 Nov 09 05:17:12.319518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 808/1635] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:12 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:13.336344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:13.336881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:13.343697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:13.344141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:13.344908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:13.345336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:13.472891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:13.480628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-96cf7b26-d3e9-4459-b6fd-358e89f7c9b1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148092 Nov 09 05:17:13.481200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 828/1636] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:13 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:14.497193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:14.497800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:14.504102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:14.504543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:14.505338 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:14.505769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:14.632038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:14.640556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4a5c038f-8ef5-4479-9146-dfef9dbb9697 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147044 Nov 09 05:17:14.641116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 809/1637] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:14 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:15.657282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:15.657892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:15.664512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:15.665226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:15.666279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:15.666839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:15.804937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:15.813201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-656e34a4-6e0c-4aa3-bb17-c8bdea3565c7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.159626 Nov 09 05:17:15.813985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 829/1638] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:15 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:16.830309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:16.830864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:16.837710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:16.838107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:16.838871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:16.839303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:16.964933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:16.972581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-11c6ad65-c2ee-4268-a1d0-c1aeadb34eb4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146048 Nov 09 05:17:16.973146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 810/1639] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:16 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:17.989425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:17.990030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:17.996945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:17.997390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:17.998162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:17.998594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:18.126487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:18.134727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-efca8ef4-86b2-4ec1-8192-9c8c44f702df tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149072 Nov 09 05:17:18.135302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 830/1640] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:17 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:19.152154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:19.152748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:19.158945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:19.159379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:19.160172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:19.160588 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:19.291232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:19.299091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f1347ecb-0d7b-464a-98a0-e111bc3bab77 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150755 Nov 09 05:17:19.299815 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 811/1641] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:19 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:20.316157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:20.316771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:20.323500 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:20.323979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:20.324763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:20.325204 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:20.456604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:20.464271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-86863e15-ee3e-424c-b99a-6b324bf2b5e1 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151795 Nov 09 05:17:20.464819 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 831/1642] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:20 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:21.481207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:21.481820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:21.488061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:21.488511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:21.489278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:21.489711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:21.616419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:21.624738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-991f2a05-92e5-404f-9bda-319ad67f03c3 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147848 Nov 09 05:17:21.625306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 812/1643] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:21 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:22.641556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:22.642169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:22.648577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:22.649033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:22.649811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:22.650248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:22.778410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:22.786247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e5984f57-2126-439f-9d62-41aa8e6d0295 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148647 Nov 09 05:17:22.786814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 832/1644] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:22 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:23.802096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:23.802678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:23.808981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:23.809417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:23.810176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:23.810598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:23.939012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:23.947198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dadc8ac2-d95e-4d4f-95c6-5b223560cf55 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148300 Nov 09 05:17:23.947785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 813/1645] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:23 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:24.964471 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:24.965077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:24.971301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:24.971780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:24.972552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:24.972987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:25.098322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:25.106603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-85bb9eb4-72a0-4ca1-870d-e5d3049f4fdf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146366 Nov 09 05:17:25.107169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 833/1646] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:24 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:26.123934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:26.124537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:26.130648 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:26.131081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:26.131868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:26.132290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:26.256041 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:26.263596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-40be89e9-5fd0-4505-977c-12223fb79b75 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.143353 Nov 09 05:17:26.264175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 814/1647] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:26 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:27.280681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:27.281321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:27.289833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:27.290403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:27.291208 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:27.291670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:27.424677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:27.433062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d962286e-8430-4b7f-b20a-45249c126239 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.156138 Nov 09 05:17:27.433620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 834/1648] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:27 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:17:28.449677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:28.450287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:28.456584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:28.457030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:28.457797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:28.458233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:28.588874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:28.596465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2ec39489-4e9c-4dd6-ab62-614d8151ede7 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150516 Nov 09 05:17:28.597018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 815/1649] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:28 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:29.613346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:29.613951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:29.620656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:29.621103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:29.621864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:29.622291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:29.748555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:29.756386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-27949443-adba-4ecc-b32f-0b223e466dac tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146683 Nov 09 05:17:29.756943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 835/1650] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:29 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:30.773226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:30.773832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:30.780146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:30.780589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:30.781356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:30.781785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:30.912602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:30.920802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cb8ca011-da41-4038-bcda-4f76b873b36c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151262 Nov 09 05:17:30.930106 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 816/1651] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:30 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:17:31.937073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:31.937672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:31.943945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:31.944419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:31.945190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:31.945620 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:32.076776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:32.084840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-669cb73c-374d-4eff-8862-ab1a06c84253 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151137 Nov 09 05:17:32.085415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 836/1652] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:31 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:33.101880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:33.103060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:33.109270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:33.109708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:33.110464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:33.110890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:33.237687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:33.245388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-34f64c63-f255-4438-b583-0893dd22f518 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147096 Nov 09 05:17:33.245943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 817/1653] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:33 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:34.261988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:34.262588 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:34.269063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:34.269505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:34.270264 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:34.270690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:34.396616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:34.404225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d025879e-8432-4d45-8c12-a98083ac5ffc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145957 Nov 09 05:17:34.404779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 837/1654] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:34 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:35.421081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:35.421680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:35.427886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:35.428330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:35.429084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:35.429508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:35.560384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:35.567999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e41706ad-1853-4c58-a222-646517c2c25a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150557 Nov 09 05:17:35.568572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 818/1655] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:35 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:36.585125 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:36.585764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:36.591750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:36.592224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:36.592993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:36.593421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:36.721870 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:36.730119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-feaba8d4-b0e9-4dc1-b072-360136fa58f9 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148679 Nov 09 05:17:36.730682 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 838/1656] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:36 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:37.746553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:37.747153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:37.753183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:37.753627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:37.754385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:37.754811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:37.880741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:37.889093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cdbbd823-b3e6-428a-88df-4ae9437332c4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146756 Nov 09 05:17:37.889917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 819/1657] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:37 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:38.906102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:38.906704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:38.912958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:38.913401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:38.914164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:38.914587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:39.048169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:39.056359 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-95dfbab1-d5da-41a7-950e-081512682224 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.153910 Nov 09 05:17:39.056919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 839/1658] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:38 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:40.072937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:40.073526 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:40.079938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:40.080380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:40.081141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:40.081565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:40.214084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:40.221724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6232310c-c616-45aa-bff6-c1e58332254a tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152459 Nov 09 05:17:40.222285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 820/1659] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:40 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:41.238493 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:41.239119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:41.245895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:41.246336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:41.247103 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:41.247529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:41.374661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:41.382439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e41cf8ca-fda4-4e20-b1f4-3956a745dd5d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147842 Nov 09 05:17:41.383155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 840/1660] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:41 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:42.398544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:42.399140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:42.405425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:42.405844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:42.406594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:42.407047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:42.542409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:42.550173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e7c53c5b-2862-4175-baa9-6526c87ba81d tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155333 Nov 09 05:17:42.550741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 821/1661] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:42 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:43.567179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:43.567817 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:43.574066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:43.574549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:43.575322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:43.575794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:43.704744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:43.712987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3ce900a4-67c5-4e21-b372-ea2f7421632c tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.149479 Nov 09 05:17:43.713552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 841/1662] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:43 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:44.730209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:44.730769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:44.737070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:44.737514 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:44.738274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:44.738705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:44.862191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:44.870371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2944acaf-5d04-43c7-bc9e-1766672cf4d4 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144495 Nov 09 05:17:44.870941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 822/1663] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:44 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:45.886161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:45.886773 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:45.893343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:45.893794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:45.894571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:45.895009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:46.022033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:46.030158 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed00cb0e-e42c-4499-9a69-13c5cfdd2adc tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147798 Nov 09 05:17:46.030723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 842/1664] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:45 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:47.046719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:47.047319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:47.053626 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:47.054068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:47.054833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:47.055913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:47.183231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:47.191015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-771a293b-f284-4bfc-875c-4742d6c349fe tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.147974 Nov 09 05:17:47.191606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 823/1665] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:47 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:48.207863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:48.208521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:48.216332 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:48.216823 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:48.217686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:48.218453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:48.347503 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:48.355420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2f87fc1c-05de-4a3e-8535-31b8283941af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151390 Nov 09 05:17:48.356029 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 843/1666] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:48 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:49.372268 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:49.372870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:49.378978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:49.379412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:49.380200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:49.380624 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:49.504698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:49.512832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c2f35c8f-9320-409a-a167-e6eb9893dc8f tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.144188 Nov 09 05:17:49.513390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 824/1667] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:49 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:50.530155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:50.530795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:50.537084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:50.537538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:50.538331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:50.538750 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:50.664090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:50.672427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bd6144fd-bbc6-4cb2-95e9-b49e4fdc1891 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.145995 Nov 09 05:17:50.672989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 844/1668] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:50 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:51.689097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:51.689697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:51.695954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:51.696406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:51.697169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:51.697597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:51.832222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:51.840751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7ff11c07-79a9-43d3-b221-3a89b73dce08 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.155351 Nov 09 05:17:51.841434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 825/1669] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:51 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:52.858343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:52.858861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:52.864822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:52.865300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:52.866086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:52.866515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:53.005968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:53.014024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-80a23494-beeb-4328-85ab-7ec416bbe62e tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.159743 Nov 09 05:17:53.014849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 845/1670] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:52 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:54.031397 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:54.032127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:54.038527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:54.038976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:54.039775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:54.040501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:54.171743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:54.179549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-04a668d2-7be6-4266-9f9c-71327c936643 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152090 Nov 09 05:17:54.180662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 826/1671] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:54 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:55.197216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:55.197914 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:55.205190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:55.205632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:55.206406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:55.206833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:55.345004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:55.352775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c4e1a24-6a66-417b-b008-7cd1a8d116bf tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.159776 Nov 09 05:17:55.353341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 846/1672] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:55 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:56.370440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:56.370988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:56.377206 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:56.377650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:56.378414 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:56.378844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:56.508957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:56.516915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cbbe8c11-dbab-4e98-bcf8-7b49d705c7a6 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150848 Nov 09 05:17:56.517482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 827/1673] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:56 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:17:57.534026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:57.534667 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:57.541525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:57.541969 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:57.542744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:57.543175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:57.669513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:57.677258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-edec427a-b1f8-499f-8c5b-6512c6694472 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146865 Nov 09 05:17:57.677826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 847/1674] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:57 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:58.693970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:58.694581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:58.701502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:58.701947 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:58.702715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:58.703506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:58.833002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:17:58.841522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-75c57afd-6daa-461d-bdb9-91c70ca06283 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.151221 Nov 09 05:17:58.842191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 828/1675] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:58 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:17:59.858726 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:17:59.859374 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:17:59.865665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:59.866149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:59.866928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:17:59.868031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:17:59.996192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:00.003917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ac2e4577-5673-41af-840f-908b8af7c1af tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.148999 Nov 09 05:18:00.004487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 848/1676] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:17:59 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:18:01.020001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:01.020612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:01.027425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:01.027904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:01.028677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:01.029112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:01.158660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:01.167186 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5cc537a6-5804-46d0-82d9-81ff470dfeb0 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150882 Nov 09 05:18:01.168683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 829/1677] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:01 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:18:02.184430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:02.185040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:02.191297 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:02.191784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:02.192563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:02.193005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:02.318916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:02.327386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-da6e82f7-3d52-4a91-a2a1-94c2a1d45865 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.146534 Nov 09 05:18:02.327984 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 849/1678] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:02 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:18:03.344358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:03.344884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:03.350988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:03.351424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:03.352807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:03.353231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:03.485378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:03.493241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-46bd96bc-b6bf-4114-bc94-fde7251c7074 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.152766 Nov 09 05:18:03.493805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 830/1679] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:03 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:18:04.510122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:04.510728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] [instance: fa39714e-2b95-4e72-83de-9acc03f82eb2] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:04.517405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:04.517855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:04.518623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:04.519062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:04.648903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b8ce2b334d42c8bf0196e992180e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79869bd25d3c47ca87597d1801b9d710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:04.656586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2570a287-cbb0-46e7-9d03-61c290710a72 tempest-VolumesSnapshotTestJSON-298792175 tempest-VolumesSnapshotTestJSON-298792175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2" status: 200 len: 1559 microversion: 2.1 time: 0.150638 Nov 09 05:18:04.657153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 850/1680] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:04 2021] GET /compute/v2.1/servers/fa39714e-2b95-4e72-83de-9acc03f82eb2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:18:11.632620 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:18:11.633072 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:18:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:18:11.769291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:11.769785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:11.775785 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:11.776234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:11.777000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:11.777467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:11.801864 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:18:11.878870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c29534dc-2116-4776-b061-61b78661d4d2 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 204 len: 0 microversion: 2.1 time: 0.112912 Nov 09 05:18:11.880303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 831/1681] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:18:11 2021] DELETE /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:18:11.887748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:11.888352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:11.894549 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:11.894994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:11.895792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:11.896226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:12.031013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:12.038141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-af5284f1-754f-41b1-9079-e0556fed4a3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1513 microversion: 2.1 time: 0.153992 Nov 09 05:18:12.038696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 851/1682] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:11 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:18:13.056051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:13.056756 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:13.062911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:13.063358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:13.064158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:13.064591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:13.192471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc41f90272e4a549aad1634f08342a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9bea92048e49debbf053fea8eb2b9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:18:13.200329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3a44133a-f54e-4f61-a14b-247abc026317 tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 200 len: 1513 microversion: 2.1 time: 0.148333 Nov 09 05:18:13.200897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 832/1683] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:13 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:18:13.397590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-5ea768e4-7463-4ec3-9122-24e43acb8ac0 req-4faf7a6b-1015-42f5-910e-0c8e1c66686b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e7964e-3c1d-4928-9dfa-399d3721c871", "name": "network-vif-deleted", "tag": "e8784b0f-5ec8-4da9-b0e3-a4db5b8d59bf"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:18:13.399226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:18:13.399226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:18:13.407392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-5ea768e4-7463-4ec3-9122-24e43acb8ac0 req-4faf7a6b-1015-42f5-910e-0c8e1c66686b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:13.407858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-5ea768e4-7463-4ec3-9122-24e43acb8ac0 req-4faf7a6b-1015-42f5-910e-0c8e1c66686b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:13.418477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-5ea768e4-7463-4ec3-9122-24e43acb8ac0 req-4faf7a6b-1015-42f5-910e-0c8e1c66686b service nova] Creating event network-vif-deleted:e8784b0f-5ec8-4da9-b0e3-a4db5b8d59bf for instance 12e7964e-3c1d-4928-9dfa-399d3721c871 on hv-cinder-81713 Nov 09 05:18:13.424542 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-5ea768e4-7463-4ec3-9122-24e43acb8ac0 req-4faf7a6b-1015-42f5-910e-0c8e1c66686b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 Nov 09 05:18:13.425307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 852/1684] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:18:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:18:14.216780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:18:14.217411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] [instance: 12e7964e-3c1d-4928-9dfa-399d3721c871] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:18:14.223675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:14.224122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:14.224883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:18:14.225311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:18:14.237842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] HTTP exception thrown: Instance 12e7964e-3c1d-4928-9dfa-399d3721c871 could not be found. Nov 09 05:18:14.238417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] Returning 404 to user: Instance 12e7964e-3c1d-4928-9dfa-399d3721c871 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:18:14.239257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-79f45da9-ca67-48ce-951f-3b964525df3b tempest-AttachVolumeNegativeTest-456871069 tempest-AttachVolumeNegativeTest-456871069-project] 10.222.0.41 "GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871" status: 404 len: 111 microversion: 2.1 time: 0.026100 Nov 09 05:18:14.239748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 833/1685] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:18:14 2021] GET /compute/v2.1/servers/12e7964e-3c1d-4928-9dfa-399d3721c871 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:18:18.398376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:18:18.398896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:18:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:19:51.629386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:19:51.629944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:19:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:19:54.374134 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:19:54.375340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:19:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:20:08.887418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72aeebc8-7b41-4ca4-acaa-c7dc623a4daa] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 05:20:08.891866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:20:08.892440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:20:08.898350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:20:08.898791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:20:08.899556 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:20:08.900012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:20:08.912867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] HTTP exception thrown: Instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 could not be found. Nov 09 05:20:08.913445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Returning 404 to user: Instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:20:08.914252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-04794893-ccf1-426f-b655-c36279bef565 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 404 len: 111 microversion: 2.1 time: 0.028803 Nov 09 05:20:08.914776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 853/1686] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:20:08 2021] DELETE /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:20:08.920537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ccbb107-0d10-4610-97f2-19b064307277] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 09 05:20:08.924069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:20:08.924711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 6308e5b8-e07c-479a-abf3-726c34bb3ab9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:20:08.930465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:20:08.930902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:20:08.931688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:20:08.932120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:20:08.945442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] HTTP exception thrown: Instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 could not be found. Nov 09 05:20:08.946016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Returning 404 to user: Instance 6308e5b8-e07c-479a-abf3-726c34bb3ab9 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:20:08.946877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eaa687b8-f6c2-4ee4-bed3-2fd26e8050c5 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9" status: 404 len: 111 microversion: 2.1 time: 0.028206 Nov 09 05:20:08.947376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 834/1687] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:20:08 2021] GET /compute/v2.1/servers/6308e5b8-e07c-479a-abf3-726c34bb3ab9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:20:56.274120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] [72aeebc8-7b41-4ca4-acaa-c7dc623a4daa] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43712. Nov 09 05:20:56.400920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-f1ae20be-bbf0-4788-99eb-fb5ea53a5678 req-3c364bb5-dafe-47ec-a346-f644cb7bd9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa39714e-2b95-4e72-83de-9acc03f82eb2", "name": "network-vif-deleted", "tag": "1052eb61-9d88-48ed-ae53-fc737786ab8f"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:20:56.402461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:20:56.402461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:20:56.409233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-f1ae20be-bbf0-4788-99eb-fb5ea53a5678 req-3c364bb5-dafe-47ec-a346-f644cb7bd9c7 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:20:56.409669 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-f1ae20be-bbf0-4788-99eb-fb5ea53a5678 req-3c364bb5-dafe-47ec-a346-f644cb7bd9c7 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:20:56.419904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-f1ae20be-bbf0-4788-99eb-fb5ea53a5678 req-3c364bb5-dafe-47ec-a346-f644cb7bd9c7 service nova] Creating event network-vif-deleted:1052eb61-9d88-48ed-ae53-fc737786ab8f for instance fa39714e-2b95-4e72-83de-9acc03f82eb2 on hv-cinder-81713 Nov 09 05:20:56.425677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-f1ae20be-bbf0-4788-99eb-fb5ea53a5678 req-3c364bb5-dafe-47ec-a346-f644cb7bd9c7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184959 Nov 09 05:20:56.426253 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 854/1688] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:20:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:21:02.550182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:21:02.550688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:21:02.566415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:21:02.566859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:21:02.567643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:21:02.568304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:21:02.583239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ccbb107-0d10-4610-97f2-19b064307277] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43778. Nov 09 05:21:02.584346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] HTTP exception thrown: Instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 could not be found. Nov 09 05:21:02.584932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Returning 404 to user: Instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:21:02.585757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5251b36f-ecc3-413b-b158-0b2e3118820e tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 404 len: 111 microversion: 2.1 time: 0.039375 Nov 09 05:21:02.586297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 835/1689] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:21:02 2021] DELETE /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:21:02.596916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:21:02.597591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 4805f839-96d2-42b9-8e81-1ebd537fdc33] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:21:02.603562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:21:02.604047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:21:02.604820 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:21:02.605245 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:21:02.618003 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] HTTP exception thrown: Instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 could not be found. Nov 09 05:21:02.618654 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Returning 404 to user: Instance 4805f839-96d2-42b9-8e81-1ebd537fdc33 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:21:02.619595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2c69d692-04aa-412a-b61a-b32da6269022 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33" status: 404 len: 111 microversion: 2.1 time: 0.027689 Nov 09 05:21:02.620176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 855/1690] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:21:02 2021] GET /compute/v2.1/servers/4805f839-96d2-42b9-8e81-1ebd537fdc33 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:21:31.649138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:21:31.649684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:21:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:21:38.416535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:21:38.417105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:21:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:23:11.647132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:23:11.647672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:23:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:23:14.392200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:23:14.392692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:23:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:23:41.888970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:23:41.889683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:23:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:23:44.178828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:23:44.179377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:23:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:23:54.062365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:54.062968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:54.071530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:54.072004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:54.072768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:54.073198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:54.098502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:23:54.170127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f1b2ba33-7795-40ff-a19e-7d347fe8631c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 204 len: 0 microversion: 2.1 time: 0.112205 Nov 09 05:23:54.170702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 836/1691] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:23:54 2021] DELETE /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:23:54.180473 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:54.181058 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:54.187607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:54.188076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:54.189453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:54.189987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:54.397067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:23:54.404255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b7417c4f-02be-46c8-bcaf-2ba28f5f8204 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1508 microversion: 2.1 time: 0.228442 Nov 09 05:23:54.404808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 856/1692] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:23:54 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:23:55.421986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:55.423208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:55.429468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:55.429913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:55.430685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:55.431117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:55.568908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-4780a379-1f6d-4994-aad0-febf77c67ef5 req-32e666a5-ac9e-4730-ab99-2468cd7f1923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e4cb58-5dfa-445a-815e-30dcfaab94e9", "name": "network-vif-deleted", "tag": "8e9494d2-6026-4da9-9838-657923b0d3c9"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:23:55.570416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:23:55.570416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:23:55.572198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:23:55.581271 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eefc9fda-1f46-4c6b-b1f5-8113dc71455d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 200 len: 1466 microversion: 2.1 time: 0.163267 Nov 09 05:23:55.585639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 837/1693] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:23:55 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 1466 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:23:55.590199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-4780a379-1f6d-4994-aad0-febf77c67ef5 req-32e666a5-ac9e-4730-ab99-2468cd7f1923 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:55.590199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-4780a379-1f6d-4994-aad0-febf77c67ef5 req-32e666a5-ac9e-4730-ab99-2468cd7f1923 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:55.602251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-4780a379-1f6d-4994-aad0-febf77c67ef5 req-32e666a5-ac9e-4730-ab99-2468cd7f1923 service nova] Creating event network-vif-deleted:8e9494d2-6026-4da9-9838-657923b0d3c9 for instance a2e4cb58-5dfa-445a-815e-30dcfaab94e9 on hv-cinder-81713 Nov 09 05:23:55.613884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-4780a379-1f6d-4994-aad0-febf77c67ef5 req-32e666a5-ac9e-4730-ab99-2468cd7f1923 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054155 Nov 09 05:23:55.614662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 857/1694] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:23:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:23:56.599960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:56.600558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: a2e4cb58-5dfa-445a-815e-30dcfaab94e9] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:56.606750 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:56.607217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:56.608027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:56.608451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:56.621687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] HTTP exception thrown: Instance a2e4cb58-5dfa-445a-815e-30dcfaab94e9 could not be found. Nov 09 05:23:56.622259 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Returning 404 to user: Instance a2e4cb58-5dfa-445a-815e-30dcfaab94e9 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:23:56.623055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eaf56b72-1847-4a74-8d89-efe63038fdcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9" status: 404 len: 111 microversion: 2.1 time: 0.026780 Nov 09 05:23:56.623558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 838/1695] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:23:56 2021] GET /compute/v2.1/servers/a2e4cb58-5dfa-445a-815e-30dcfaab94e9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:23:56.632291 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:56.632871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:56.639152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:56.639599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:56.640427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:56.640861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:56.664700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:23:56.737070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c24288d2-580d-415f-8cb9-19904eeeb024 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "DELETE /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 204 len: 0 microversion: 2.1 time: 0.109005 Nov 09 05:23:56.737698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 858/1696] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:23:56 2021] DELETE /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:23:56.746616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:56.747221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:56.753360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:56.753809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:56.754577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:56.755008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:57.109034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:23:57.117339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4efa83b8-2186-4090-9706-f58a6471d0a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.375323 Nov 09 05:23:57.117977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 839/1697] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:23:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:23:58.136035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:58.136761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:58.142942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:58.143482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:58.144315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:58.144749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:58.429098 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:23:58.434616 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-89f0ef32-61ac-4cc6-91cc-5455cb7511ad tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1568 microversion: 2.1 time: 0.303267 Nov 09 05:23:58.435209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 859/1698] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:23:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:23:58.719074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-95dea08b-1d16-4b35-b9e0-883769f14a74 req-ea5d0dea-bec2-46fd-9fd5-a5c386d35f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367541e4-c608-43b0-90da-677a42dc9b16", "name": "network-vif-deleted", "tag": "4a887e80-10aa-4e62-9e15-7d3eb5cf25d5"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:23:58.721251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:23:58.721251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:23:58.734149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-95dea08b-1d16-4b35-b9e0-883769f14a74 req-ea5d0dea-bec2-46fd-9fd5-a5c386d35f75 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:58.734583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-95dea08b-1d16-4b35-b9e0-883769f14a74 req-ea5d0dea-bec2-46fd-9fd5-a5c386d35f75 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:58.747552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-95dea08b-1d16-4b35-b9e0-883769f14a74 req-ea5d0dea-bec2-46fd-9fd5-a5c386d35f75 service nova] Creating event network-vif-deleted:4a887e80-10aa-4e62-9e15-7d3eb5cf25d5 for instance 367541e4-c608-43b0-90da-677a42dc9b16 on hv-cinder-81713 Nov 09 05:23:58.753536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-95dea08b-1d16-4b35-b9e0-883769f14a74 req-ea5d0dea-bec2-46fd-9fd5-a5c386d35f75 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040916 Nov 09 05:23:58.754356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 840/1699] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:23:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:23:59.451106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:23:59.451721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:23:59.458440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:59.458878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:59.459656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:23:59.460087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:23:59.520822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:23:59.528413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a211254-d250-4f2b-a5d6-46194256c729 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080941 Nov 09 05:23:59.528965 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 860/1700] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:23:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:00.546425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:00.547243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:00.554151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:00.554591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:00.555410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:00.555862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:00.614708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:00.622373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4be7e439-ea5e-4f06-a613-ab39125c3d26 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080441 Nov 09 05:24:00.622933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 841/1701] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:01.639415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:01.640077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:01.646800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:01.647248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:01.648043 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:01.648478 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:01.708268 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:01.715913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ff8b5ebc-1771-4ac3-82d7-fb65d1cfb653 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080076 Nov 09 05:24:01.716466 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 861/1702] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:24:02.732894 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:02.733493 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:02.735927 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ccbb107-0d10-4610-97f2-19b064307277] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 09 05:24:02.740294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:02.740729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:02.741485 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:02.741911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:02.799329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:02.807008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-769e1e59-90b8-49f5-9ccd-80272204d364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077759 Nov 09 05:24:02.807575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 842/1703] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:03.823699 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:03.824880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:03.831209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:03.831677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:03.832511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:03.832941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:03.891584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:03.899195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f787223b-c46b-4b39-bd08-252713075019 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079282 Nov 09 05:24:03.899774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 862/1704] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:04.916561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:04.917161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:04.934581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:04.935022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:04.935812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:04.936240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:04.941070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ccbb107-0d10-4610-97f2-19b064307277] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 45564. Nov 09 05:24:04.998672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:05.006343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-26f8abff-139e-4000-a01f-17d7e9993e8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.094950 Nov 09 05:24:05.006897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 843/1705] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:06.023259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:06.023892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:06.030042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:06.030482 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:06.031249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:06.032299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:06.090431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:06.098779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fd5322f3-7e06-43c4-8ed4-0dc8a7c5ae46 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079562 Nov 09 05:24:06.099346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 863/1706] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:07.115172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:07.115808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:07.121982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:07.122420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:07.123171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:07.123594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:07.182163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:07.189827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a66964ef-c72a-4aed-b582-0750a124dd04 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078296 Nov 09 05:24:07.190380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 844/1707] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:08.206720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:08.207333 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:08.213765 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:08.214219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:08.215003 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:08.215441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:08.274833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:08.283240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b29c7d23-dfc0-45ff-a791-f901a05e6364 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080723 Nov 09 05:24:08.283835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 864/1708] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:09.299941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:09.300590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:09.307752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:09.309429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:09.310207 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:09.311349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:09.380939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:09.388860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0b717e3b-ecdb-4294-be16-9ea340ce0325 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.092715 Nov 09 05:24:09.389415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 845/1709] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:24:10.406920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:10.407512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:10.413738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:10.414184 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:10.414947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:10.415398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:10.473453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:10.481184 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-12df6614-4968-4c13-97d6-c38581520dc2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077939 Nov 09 05:24:10.481748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 865/1710] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:11.498032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:11.498639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:11.504913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:11.505352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:11.506114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:11.506544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:11.565730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:11.573762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-78e08b71-d299-4a0d-a7d3-7739f045ea53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079366 Nov 09 05:24:11.574382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 846/1711] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:12.591566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:12.592191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:12.598946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:12.599387 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:12.600173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:12.600600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:12.662182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:12.669923 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-bd8caf6a-35dc-4206-8c32-0119d7d46399 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082169 Nov 09 05:24:12.670486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 866/1712] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:13.686007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:13.686633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:13.693471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:13.693913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:13.694672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:13.695099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:13.752387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:13.760192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1151dc77-6a31-4cbd-9cc4-2c322708a56d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077895 Nov 09 05:24:13.760752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 847/1713] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:14.776095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:14.776703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:14.783469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:14.783930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:14.784699 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:14.785737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:14.844301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:14.852544 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cb45acbe-9c5e-4630-8770-86ad13a8a8b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080086 Nov 09 05:24:14.853102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 867/1714] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:15.869059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:15.869612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:15.876392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:15.876959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:15.877846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:15.878326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:15.935984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:15.944210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c7cfb0be-a89b-408a-b4fb-ebf3c25342b0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078927 Nov 09 05:24:15.944767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 848/1715] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:16.960743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:16.961350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:16.967578 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:16.968064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:16.968837 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:16.969268 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:17.028440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:17.036153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2120117b-81a4-44b0-b02f-8c2dd967bcbb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079129 Nov 09 05:24:17.036718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 868/1716] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:18.052715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:18.053350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:18.059644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:18.060095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:18.060867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:18.061300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:18.122012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:18.129640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3fa29683-bd20-40b2-ad65-93ad34daf96f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080667 Nov 09 05:24:18.130195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 849/1717] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:19.145508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:19.146114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:19.152378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:19.152825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:19.153600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:19.154038 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:19.212509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:19.220525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-23d2a402-92b0-4c93-a768-d93889bdbcbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078699 Nov 09 05:24:19.221088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 869/1718] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:20.237076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:20.237666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:20.243931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:20.244377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:20.245137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:20.245568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:20.303338 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:20.310909 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-304431ff-94e5-43b9-ad99-699dcef4b355 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077507 Nov 09 05:24:20.311468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 850/1719] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:21.327951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:21.328544 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:21.334839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:21.335290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:21.336100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:21.336537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:21.395576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:21.403273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f1123ed7-99cd-4110-bce6-0824446ea2d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079066 Nov 09 05:24:21.403869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 870/1720] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:22.420406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:22.420999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:22.427884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:22.428320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:22.429076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:22.429497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:22.486928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:22.494368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3c6b61e7-a1ef-4a28-baa6-65253a602b23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077630 Nov 09 05:24:22.494918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 851/1721] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:23.511633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:23.512256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:23.518457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:23.518900 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:23.519681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:23.520112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:23.578022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:23.585721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-72b36bbf-2ee8-4b61-b5d6-6651a96d2ec5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078070 Nov 09 05:24:23.586278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 871/1722] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:24.602748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:24.603347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:24.609748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:24.610823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:24.611610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:24.612062 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:24.675481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:24.683077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d96ed935-7dee-4560-9c73-e5537f6fd5ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084052 Nov 09 05:24:24.683666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 852/1723] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:25.699509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:25.700147 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:25.706695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:25.707136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:25.707946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:25.708380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:25.769436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:25.777176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e81aec94-3fb3-4296-a021-e63256559e84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081393 Nov 09 05:24:25.777737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 872/1724] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:26.794046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:26.794651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:26.801548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:26.801997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:26.802772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:26.803209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:26.864370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:26.872158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bff2e63b-01a3-4b42-b4b0-0e5976ee8f69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081840 Nov 09 05:24:26.872726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 853/1725] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:27.890030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:27.890627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:27.896497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:27.896948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:27.897721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:27.898155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:27.956546 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:27.964101 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b8c74e1c-bf89-4f29-9c12-cf11b1927de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078020 Nov 09 05:24:27.964674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 873/1726] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:28.980574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:28.981171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:28.987441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:28.987907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:28.988695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:28.989120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:29.046869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:29.054565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ea3382eb-c24f-4461-bb6e-ec0a5246e66d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077658 Nov 09 05:24:29.055125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 854/1727] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:30.071429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:30.072069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:30.079260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:30.079730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:30.080495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:30.080923 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:30.139683 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:30.147477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-91470ef7-fdca-446d-8692-71c923cab769 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079692 Nov 09 05:24:30.148078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 874/1728] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:31.163890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:31.164488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:31.170658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:31.171098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:31.171871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:31.172917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:31.232630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:31.240962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b5ecc757-0079-4005-8c5f-a71fdc6caac6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080762 Nov 09 05:24:31.241521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 855/1729] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:32.257885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:32.258497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:32.264784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:32.265231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:32.266004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:32.266437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:32.324443 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:32.332066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a336abb-5150-466d-9444-cb7e54396a45 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078148 Nov 09 05:24:32.332626 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 875/1730] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:24:33.348702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:33.349315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:33.355694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:33.356136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:33.356894 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:33.357318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:33.416034 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:33.423674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c642b3d-f471-4ea8-bfd8-aa2cc081dac7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078766 Nov 09 05:24:33.424234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 856/1731] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:34.441020 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:34.441622 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:34.447905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:34.448358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:34.449138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:34.449576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:34.507986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:34.515918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-faf95015-02e4-40e9-9e18-721d7114f7e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079256 Nov 09 05:24:34.516483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 876/1732] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:35.532978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:35.533596 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:35.539557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:35.540039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:35.540791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:35.541213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:35.599236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:35.607585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0c3f9559-7a1d-4e24-b2c6-a104bdf72cb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078826 Nov 09 05:24:35.608162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 857/1733] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:36.624076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:36.624681 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:36.631419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:36.631895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:36.632919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:36.633352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:36.691653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:36.699182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-10e4b647-96fa-4b6c-83bf-d667a157750e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078749 Nov 09 05:24:36.699761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 877/1734] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:37.716398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:37.717032 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:37.723952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:37.724403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:37.725426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:37.725861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:37.784180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:37.791767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3494498d-46dc-4277-bc91-b3364cd830ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079677 Nov 09 05:24:37.792321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 858/1735] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:38.808200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:38.808802 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:38.814977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:38.815416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:38.816219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:38.816647 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:38.878603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:38.886651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c6360d1b-22a5-4901-af50-ff92ade6524a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082099 Nov 09 05:24:38.887220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 878/1736] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:39.903460 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:39.904085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:39.910344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:39.910782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:39.911541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:39.911991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:39.976754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:39.984385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4efca8a0-d5dd-4091-909b-f5b2a444c8eb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084637 Nov 09 05:24:39.985455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 859/1737] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:41.001100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:41.001698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:41.008429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:41.008871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:41.009631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:41.010427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:41.068521 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:41.076109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c4beb519-4f3a-435b-9d85-d1c3c4c4e312 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079211 Nov 09 05:24:41.076679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 879/1738] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:42.093045 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:42.093636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:42.100166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:42.100613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:42.101382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:42.101813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:42.159795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:42.167479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-305385ba-e66e-43aa-8d5c-51cd3b1ec7d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078099 Nov 09 05:24:42.168068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 860/1739] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:43.184325 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:43.184951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:43.191142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:43.191584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:43.192377 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:43.192805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:43.253237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:43.261154 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5339e3b1-1119-4f08-8b2c-222ad358faec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080603 Nov 09 05:24:43.261715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 880/1740] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:44.276992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:44.277595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:44.283824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:44.284274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:44.285039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:44.285470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:44.345571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:44.353131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-762934bc-aa9e-4fc6-acf6-a7193fffed1e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079765 Nov 09 05:24:44.353697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 861/1741] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:45.370016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:45.370623 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:45.377437 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:45.377886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:45.378655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:45.379086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:45.438231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:45.445835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3a141014-f069-4ea6-ab00-c987f1d845df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079543 Nov 09 05:24:45.446399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 881/1742] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:46.462173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:46.462771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:46.469613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:46.470048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:46.470800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:46.471224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:46.527807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:46.536198 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-63cb2dd0-949f-488f-b492-120011140eb7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077685 Nov 09 05:24:46.536757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 862/1743] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:47.553206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:47.553814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:47.560116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:47.560563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:47.561337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:47.561767 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:47.620105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:47.627724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fea7aef4-f652-4477-9d05-8dbf3107c01c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078195 Nov 09 05:24:47.628285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 882/1744] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:48.644732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:48.645337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:48.651561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:48.652041 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:48.652818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:48.653272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:48.711707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:48.719567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37a1a9c0-de9a-4a62-88d5-bd3b7f3b9598 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079212 Nov 09 05:24:48.720160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 863/1745] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:49.736063 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:49.736689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:49.742924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:49.743371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:49.744174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:49.744611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:49.802766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:49.810475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e8e98664-c616-439e-bde5-f4d4217cf449 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078069 Nov 09 05:24:49.811036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 883/1746] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:50.827666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:50.828180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:50.834461 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:50.834898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:50.835676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:50.836105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:50.895244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:50.902895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-49cc4c8d-4126-49ca-a3c7-9226f4502f8b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079041 Nov 09 05:24:50.903450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 864/1747] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:51.665914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:24:51.666126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:24:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:24:51.920105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:51.920709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:51.927411 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:51.927884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:51.928656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:51.929087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:51.989922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:51.997593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-676ca003-5b1f-4a64-83c7-e7241baa1ca9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081269 Nov 09 05:24:51.998150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 884/1748] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:53.014892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:53.015489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:53.021786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:53.022224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:53.022977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:53.023398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:53.080744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:53.088208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-43762a33-5c05-4feb-af89-448174f984c1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.076983 Nov 09 05:24:53.088759 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 865/1749] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:54.105450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:54.106054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:54.112800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:54.113240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:54.113998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:54.114424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:54.171858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:54.179910 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d5b4f1c0-db3f-4a1f-96ce-b3b7f7e2cc1c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078408 Nov 09 05:24:54.180476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 885/1750] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:55.196880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:55.197484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:55.203847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:55.204951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:55.205716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:55.206147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:55.275313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:55.284477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cb74f675-1e34-4a7c-89ff-e9af37c14c3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.091269 Nov 09 05:24:55.285058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 866/1751] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:56.301455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:56.302064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:56.308023 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:56.308474 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:56.309252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:56.309692 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:56.372448 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:56.380825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8858050-c429-4773-83b5-766e1dfd1a54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.083454 Nov 09 05:24:56.381334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 886/1752] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:57.397590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:57.398191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:57.404444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:57.404889 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:57.405650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:57.406080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:57.466379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:57.474585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-53a41e97-13e6-4c13-9d88-7c8ef50d5422 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080698 Nov 09 05:24:57.475146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 867/1753] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:24:58.434054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:24:58.434666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:24:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:24:58.491343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:58.491920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:58.498317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:58.498766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:58.499540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:58.500004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:58.558600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:58.566457 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-efda6d6a-ab4d-4a2a-b5ad-a8719280be2a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078715 Nov 09 05:24:58.567021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 887/1754] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:24:59.583581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:24:59.584211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:24:59.590424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:59.590870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:59.591644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:24:59.592082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:24:59.650519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:24:59.658681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c2b67d6e-9e47-417f-b5b7-3372e1039e3e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078799 Nov 09 05:24:59.659237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 868/1755] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:24:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:00.675670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:00.676226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:00.682433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:00.682878 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:00.683678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:00.684114 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:00.742599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:00.750276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7f019b44-68b5-45a9-b285-4cfb33c67404 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078905 Nov 09 05:25:00.750831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 888/1756] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:01.768085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:01.768680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:01.774908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:01.775346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:01.776137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:01.776562 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:01.835920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:01.843662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4cd46cd1-69d5-473e-abef-da4b00033340 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079883 Nov 09 05:25:01.844236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 869/1757] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:02.860067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:02.861112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:02.867130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:02.867611 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:02.868409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:02.868840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:02.927167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:02.934829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-19910dee-60af-4c28-91e8-814223c6375e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078490 Nov 09 05:25:02.935381 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 889/1758] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:03.951433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:03.952064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:03.958935 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:03.959380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:03.960299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:03.961050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:04.026003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:04.033719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7a453ba4-5d25-41dc-b4f4-dc383015358e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.086135 Nov 09 05:25:04.034302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 870/1759] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:05.050797 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:05.051406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:05.057699 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:05.058146 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:05.058920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:05.059352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:05.120976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:05.128747 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6d0d913f-9cf0-4c42-93e7-626a3e3a77db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082224 Nov 09 05:25:05.129313 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 890/1760] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:06.145595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:06.146225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:06.152147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:06.152593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:06.153362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:06.153791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:06.211070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:06.218834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-13a9832b-af25-40f7-a378-bb99cd9c73d6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077075 Nov 09 05:25:06.219396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 871/1761] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:07.235943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:07.236555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:07.242789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:07.243236 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:07.244039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:07.244474 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:07.302794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:07.310464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c6ab0bc3-0db6-4a75-bf8a-febe9f4a0915 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078234 Nov 09 05:25:07.311031 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 891/1762] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:08.327387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:08.328024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:08.334646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:08.335080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:08.335872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:08.336371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:08.397536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:08.405228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-164cffe7-a54b-434a-8833-d2af8b2983cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081471 Nov 09 05:25:08.405786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 872/1763] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:09.421677 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:09.422267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:09.430761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:09.431206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:09.431996 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:09.432427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:09.492489 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:09.500141 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4aa3e3a3-9218-407d-96b7-9b53abfa1456 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082124 Nov 09 05:25:09.500703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 892/1764] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:10.516887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:10.517495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:10.523716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:10.524166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:10.524929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:10.525358 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:10.585781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:10.593499 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f5cac38-0518-4917-a87a-27e666e7c15e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080292 Nov 09 05:25:10.594057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 873/1765] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:11.609911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:11.610518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:11.617257 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:11.617699 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:11.618486 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:11.618912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:11.676689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:11.684284 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b7363618-26bc-4586-be50-f783237be2dd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077998 Nov 09 05:25:11.684844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 893/1766] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:12.700697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:12.701290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:12.708002 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:12.708436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:12.709232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:12.709637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:12.766891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:12.774970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7d97fdfd-b440-450d-9be9-09d07e42243b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078007 Nov 09 05:25:12.775522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 874/1767] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:13.791032 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:13.791553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:13.797849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:13.798292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:13.799738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:13.800190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:13.860863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:13.869377 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-37a5d644-3ae9-4010-9017-ed86ab47b0c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082035 Nov 09 05:25:13.869978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 894/1768] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:14.886139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:14.886776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:14.893159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:14.893597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:14.894353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:14.894776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:14.952175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:14.959675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8b482027-4f12-4fa0-b590-c5ac93af98be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077205 Nov 09 05:25:14.960228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 875/1769] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:15.976110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:15.976709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:15.982838 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:15.983279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:15.984133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:15.984562 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:16.042999 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:16.050827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c45e14ee-32ca-4a65-8d5c-e27abc0dafa1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078418 Nov 09 05:25:16.051392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 895/1770] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:17.067120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:17.067835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:17.074175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:17.074616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:17.075378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:17.075840 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:17.133791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:17.141239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-93d946e0-0f88-4377-9d6b-dd9c97d3580a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077809 Nov 09 05:25:17.141797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 876/1771] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:18.158006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:18.158600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:18.165456 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:18.165893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:18.166657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:18.167085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:18.230816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:18.238531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8a6dee1b-a079-4999-88cd-3debfec9490c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084194 Nov 09 05:25:18.239087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 896/1772] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:19.254841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:19.255442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:19.261969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:19.262503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:19.263261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:19.263716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:19.325565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:19.333866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cb38086f-ef85-4373-aaa6-0643235d7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082697 Nov 09 05:25:19.334427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 877/1773] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:20.349507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:20.350135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:20.356518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:20.356967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:20.357742 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:20.358179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:20.417137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:20.425354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-dc4fabe9-326c-4be8-a49e-4887a2adab92 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079564 Nov 09 05:25:20.425920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 897/1774] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:21.442273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:21.442883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:21.449083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:21.449515 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:21.450270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:21.450693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:21.509516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:21.517193 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-50c153ef-4fa8-435b-93d6-07f6b5d6cc84 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079075 Nov 09 05:25:21.517751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 878/1775] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:22.533686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:22.534316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:22.540658 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:22.541099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:22.541875 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:22.542301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:22.601409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:22.609056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4a1e89bf-2e8c-4ba3-9027-ac150156eefd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079130 Nov 09 05:25:22.609621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 898/1776] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:23.625725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:23.626334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:23.632933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:23.633381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:23.634152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:23.634586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:23.695672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:23.703409 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-375db63c-5114-4a2a-8e99-bdcfee27b478 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081453 Nov 09 05:25:23.704003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 879/1777] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:24.720222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:24.720828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:24.727248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:24.727713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:24.728514 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:24.728971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:24.788833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:24.796423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4a2fefa0-5009-435b-999e-6ad296080f8c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080070 Nov 09 05:25:24.796991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 899/1778] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:25.812900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:25.813507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:25.820366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:25.820758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:25.821605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:25.822036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:25.882824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:25.890517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a335e8c4-ca67-4fdc-958e-22a8947cb2b9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081378 Nov 09 05:25:25.891076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 880/1779] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:26.907906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:26.908537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:26.915354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:26.915848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:26.916628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:26.917056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:26.975708 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:26.983321 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-737bcff1-2319-4526-a329-d55de56dafb0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079356 Nov 09 05:25:26.983921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 900/1780] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:28.004502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:28.005351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:28.014645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:28.015328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:28.016673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:28.017336 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:28.087101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:28.094717 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-61d157e6-a935-4ff9-aeb4-62591a1e6759 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.098008 Nov 09 05:25:28.095273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 881/1781] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:29.111251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:29.111947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:29.118237 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:29.118685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:29.119462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:29.119926 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:29.179531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:29.187247 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-32b24b73-75d3-450f-8aae-b440ab1c5119 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079788 Nov 09 05:25:29.187834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 901/1782] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:30.203668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:30.204305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:30.210608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:30.211057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:30.211858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:30.212290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:30.271542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:30.279119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-40658c6e-3423-4f62-af79-90aea4a26f79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079165 Nov 09 05:25:30.279701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 882/1783] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:31.295285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:31.295913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:31.302754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:31.303201 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:31.304007 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:31.304441 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:31.365162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:31.372839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-64c656c1-64be-49db-a784-58ad380f26a3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081259 Nov 09 05:25:31.373410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 902/1784] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:32.389718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:32.390320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:32.397172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:32.397615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:32.398380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:32.398802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:32.460125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:32.467878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2b7d1d45-d530-492b-9af3-7096308be224 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081843 Nov 09 05:25:32.468434 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 883/1785] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:33.484301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:33.484888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:33.491809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:33.492260 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:33.493030 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:33.493464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:33.551760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:33.559576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a44e7ff9-a781-4263-aae4-b67b573df62a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078973 Nov 09 05:25:33.560166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 903/1786] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:34.576215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:34.576842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:34.583128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:34.583565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:34.584344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:34.584767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:34.642378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:34.650010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-69ce8076-75a9-4e35-891f-192d4be2f1d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077413 Nov 09 05:25:34.650564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 884/1787] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:35.667306 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:35.667933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:35.674125 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:35.674572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:35.675352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:35.675824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:35.734197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:35.741823 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1cccd1a6-d0f5-4e25-94c4-2ec55bf89554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078197 Nov 09 05:25:35.742383 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 904/1788] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:36.758442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:36.759050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:36.765295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:36.765740 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:36.766506 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:36.766939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:36.827094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:36.835668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-43f2e5a6-6815-4b53-8391-3a24508193ed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081333 Nov 09 05:25:36.836239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 885/1789] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:37.852173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:37.852715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:37.858946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:37.859395 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:37.860191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:37.860628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:37.919748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:37.927409 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-568b70d3-4cbe-490f-96c8-ddd75182d48b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079026 Nov 09 05:25:37.928006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 905/1790] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:38.945252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:38.945849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:38.952350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:38.952788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:38.953540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:38.953968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:39.013171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:39.020847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a70563d2-82be-45a6-ac56-1f76dc930ed9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080659 Nov 09 05:25:39.021398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 886/1791] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:40.037278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:40.037908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:40.044168 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:40.044545 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:40.045316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:40.045744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:40.105753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:40.113392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c8eb4513-b98b-4fe8-9389-dbd3ca863945 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079806 Nov 09 05:25:40.113951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 906/1792] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:41.130433 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:41.131271 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:41.137444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:41.137876 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:41.138630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:41.139057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:41.199610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:41.207283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a2b73da3-055d-411b-ad76-90060adb2b42 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081224 Nov 09 05:25:41.207873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 887/1793] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:42.224392 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:42.224986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:42.231196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:42.231665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:42.232433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:42.232860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:42.291193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:42.299025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8f7da568-30db-46c0-b2b4-b222fd7c7db0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078743 Nov 09 05:25:42.299607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 907/1794] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:43.316551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:43.317147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:43.323424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:43.323904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:43.324682 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:43.325114 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:43.383255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:43.390958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cf5d810a-71d4-45a3-94f5-c30d796341ec tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078108 Nov 09 05:25:43.391531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 888/1795] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:44.408369 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:44.409590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:44.415847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:44.416292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:44.417135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:44.417563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:44.480432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:44.488687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-18388e09-e175-4e2a-97a7-1e10bf0738e2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084102 Nov 09 05:25:44.489249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 908/1796] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:45.505725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:45.506593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:45.512841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:45.513283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:45.514052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:45.514479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:45.572969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:45.580666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2fdf041c-e49b-474b-8be5-1387afe9b7c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079099 Nov 09 05:25:45.581233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 889/1797] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:46.597293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:46.597897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:46.604126 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:46.604564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:46.605328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:46.605756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:46.664744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:46.672413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5dbb4a15-3a69-4a30-8c33-38daf22d2365 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078829 Nov 09 05:25:46.672977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 909/1798] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:47.689389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:47.690479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:47.696731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:47.697175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:47.697935 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:47.698368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:47.758220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:47.765908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-59e50ceb-9899-4b1e-91e9-4a3443d83499 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080164 Nov 09 05:25:47.766472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 890/1799] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:48.781932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:48.782532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:48.789386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:48.789825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:48.790618 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:48.791043 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:48.848660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:48.856406 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-95e05a2d-09b6-47c3-8a65-f93a5ba38132 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078149 Nov 09 05:25:48.856965 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 910/1800] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:49.873105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:49.873653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:49.880024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:49.880465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:49.881490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:49.881916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:49.946537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:49.954273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-18c87021-8fc2-457a-8a96-ecf0d1277d23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.085000 Nov 09 05:25:49.954832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 891/1801] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:50.970845 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:50.971452 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:50.977687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:50.978130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:50.978892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:50.979317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:51.038144 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:51.045758 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e696365b-5edc-4746-98cd-7c7e8fdabe14 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078700 Nov 09 05:25:51.046319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 911/1802] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:52.062644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:52.063227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:52.070015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:52.070453 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:52.071210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:52.071668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:52.128779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:52.136527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f275957f-38ff-452e-8435-9750d69d99b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077582 Nov 09 05:25:52.137081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 892/1803] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:53.153573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:53.154153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:53.160349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:53.160796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:53.161881 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:53.162307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:53.220217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:53.227857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6e3f26ed-dee5-45a6-b586-831aacca9d9c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077945 Nov 09 05:25:53.228420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 912/1804] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:54.245318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:54.245897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:54.252066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:54.252509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:54.253261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:54.253685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:54.311350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:54.319463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8cdc55c8-f1e9-4557-83a4-329e868b1efb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077807 Nov 09 05:25:54.320066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 893/1805] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:55.335803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:55.336421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:55.342600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:55.343040 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:55.343831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:55.344258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:55.401891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:55.409579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a569ebec-5023-4ce6-883e-275a31901020 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077437 Nov 09 05:25:55.410138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 913/1806] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:56.426007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:56.426603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:56.432856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:56.433301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:56.434066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:56.434501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:56.493664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:56.502380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-23000fb7-3bec-4bf9-b920-dd046c23b5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080072 Nov 09 05:25:56.503006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 894/1807] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:57.519884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:57.520464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:57.526342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:57.526785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:57.527539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:57.527998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:57.590255 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:57.599088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-71aca902-8914-444e-93e2-59c1ba4ddb79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.083127 Nov 09 05:25:57.599680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 914/1808] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:58.616159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:58.616755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:58.623116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:58.623561 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:58.624349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:58.624778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:58.686175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:58.694312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-64f5eb59-90a2-44d3-95d3-d96394488f62 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082430 Nov 09 05:25:58.694872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 895/1809] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:25:59.711594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:25:59.714322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:25:59.720993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:59.721524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:59.722894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:25:59.723397 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:25:59.786450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:25:59.795722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5fcf4608-a6df-41f6-b276-6184d428999c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.089211 Nov 09 05:25:59.796308 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 915/1810] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:25:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:00.812377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:00.812981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:00.819365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:00.819855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:00.820679 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:00.821105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:00.883282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:00.891059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8dbf4788-58a1-4ad7-a900-07c1cd7df4e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082374 Nov 09 05:26:00.891653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 896/1811] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:01.907653 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:01.908315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:01.914718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:01.915167 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:01.915975 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:01.916413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:01.977594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:01.985398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f39005c8-a159-40c8-ae37-f60766e2c5a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081487 Nov 09 05:26:01.985967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 916/1812] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:03.002206 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:03.002808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:03.009392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:03.009831 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:03.010585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:03.011009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:03.072860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:03.080553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9924ebb3-7ee3-483d-afe5-93da5b753d5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081937 Nov 09 05:26:03.081124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 897/1813] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:04.097198 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:04.097761 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:04.104038 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:04.104485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:04.105261 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:04.105695 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:04.169315 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:04.177730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b4f306a1-da7d-4e82-bec6-b5ade844ba11 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084429 Nov 09 05:26:04.178514 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 917/1814] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:05.194987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:05.195592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:05.201603 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:05.202050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:05.202820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:05.203255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:05.261084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:05.268780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b966eca2-7a81-4629-8abc-f7b33932ca8d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078138 Nov 09 05:26:05.269360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 898/1815] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:06.285856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:06.286516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:06.292740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:06.293185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:06.294000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:06.294430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:06.351894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:06.359455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-90a2aa06-433f-4fbc-9d26-2569262d1d40 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077808 Nov 09 05:26:06.360049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 918/1816] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:07.376587 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:07.377189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:07.383804 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:07.384258 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:07.385023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:07.385459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:07.444328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:07.451854 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f7aaebf5-e418-42c4-8cb8-e91e97f9539d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078940 Nov 09 05:26:07.452415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 899/1817] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:08.468665 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:08.469259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:08.476074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:08.476517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:08.477282 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:08.477707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:08.535835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:08.543638 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-79d286e3-417f-490d-a469-5f4b475a7748 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078732 Nov 09 05:26:08.544216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 919/1818] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:09.561290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:09.561935 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:09.568657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:09.569105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:09.570010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:09.570289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:09.627956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:09.635853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1cee2c48-1865-48ac-b51d-e2ce75e9e6d9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078200 Nov 09 05:26:09.636414 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 900/1819] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:10.652811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:10.653427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:10.660163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:10.660610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:10.661379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:10.661809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:10.719509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:10.727788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8c0565f7-37e8-43a0-a183-b5fda386d35b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078750 Nov 09 05:26:10.728357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 920/1820] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:11.744458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:11.745059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:11.751447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:11.751929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:11.752692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:11.753730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:11.813811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:11.822242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5b3706a3-818e-4afd-b54b-b2105e465e0a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081396 Nov 09 05:26:11.822748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 901/1821] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:26:12.838989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:12.839530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:12.845929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:12.846375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:12.847809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:12.848240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:12.906446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:12.913974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-610cf724-c24f-4872-94b9-00941a0a3041 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078751 Nov 09 05:26:12.914534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 921/1822] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:13.930309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:13.930941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:13.937147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:13.937583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:13.938335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:13.938756 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:14.005627 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:14.013362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d239b398-d715-4ffe-9a3a-4f513b3330ce tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.086664 Nov 09 05:26:14.013925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 902/1823] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:15.029893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:15.030501 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:15.037390 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:15.037834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:15.038597 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:15.039028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:15.097592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:15.106068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-900db772-b2ed-40d7-a0d9-e59555768923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079825 Nov 09 05:26:15.106657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 922/1824] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:16.122532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:16.123143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:16.129897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:16.130580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:16.131342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:16.131801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:16.188557 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:16.196619 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a5f14e18-e0b6-444f-8474-20ba1009a63b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077818 Nov 09 05:26:16.197171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 903/1825] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:17.212879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:17.213555 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:17.219655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:17.220098 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:17.220861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:17.221303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:17.282784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:17.290470 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-adf72427-bf08-4680-852e-45a84221d99a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081317 Nov 09 05:26:17.291033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 923/1826] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:26:18.307003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:18.307610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:18.313826 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:18.314264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:18.315017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:18.315443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:18.376148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:18.384296 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-111ac9bf-e037-49f3-8359-5eba264154db tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081029 Nov 09 05:26:18.384853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 904/1827] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:26:19.401375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:19.401958 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:19.408148 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:19.408587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:19.409389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:19.409840 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:19.467903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:19.475576 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5ab85a2d-de79-4d20-bec2-1c02fd5f3fef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077873 Nov 09 05:26:19.476162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 924/1828] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:20.492051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:20.492675 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:20.498979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:20.499423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:20.500213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:20.500646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:20.560082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:20.568508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-37c809ec-240e-4955-be7c-93ad0534556b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080140 Nov 09 05:26:20.569071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 905/1829] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:26:21.584801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:21.585417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:21.591603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:21.592084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:21.592866 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:21.593301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:21.651953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:21.659703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6dc7afb4-8917-44f4-9310-d4ee46ec7131 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078543 Nov 09 05:26:21.660274 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 925/1830] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:22.676845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:22.677443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:22.683731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:22.684178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:22.684936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:22.685368 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:22.743016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:22.750660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-45f85041-b6ce-4515-ac55-557acdd08ea9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078123 Nov 09 05:26:22.751221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 906/1831] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:23.767478 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:23.768115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:23.774417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:23.774862 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:23.775663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:23.776107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:23.834373 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:23.842100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-77a242f3-9e08-4742-a387-d6744a0af67b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078307 Nov 09 05:26:23.842669 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 926/1832] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:24.858558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:24.859240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:24.865408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:24.865846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:24.866597 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:24.867017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:24.929993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:24.937691 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-abd530c9-fdaf-4047-8782-1cc900d0431c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082866 Nov 09 05:26:24.938254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 907/1833] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:26:25.954892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:25.955502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:25.962307 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:25.962752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:25.963528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:25.964006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:26.024229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:26.031994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-86522e13-7641-4699-af9a-764580a6d591 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080812 Nov 09 05:26:26.032561 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 927/1834] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:26:27.049157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:27.049751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:27.056581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:27.057028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:27.057796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:27.058231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:27.116778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:27.124393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9ebadc2-3630-4127-a49a-c7b347de3554 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078916 Nov 09 05:26:27.124952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 908/1835] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:28.141361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:28.141963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:28.147909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:28.148358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:28.149128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:28.149557 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:28.211346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:28.219527 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0496e8b2-2a11-41ba-90b1-2ba200543830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081861 Nov 09 05:26:28.220136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 928/1836] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:29.236082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:29.236669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:29.242872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:29.243312 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:29.244094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:29.244524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:29.313516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:29.321873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9bb77107-0985-4978-a763-f3bad49b77e8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.089446 Nov 09 05:26:29.322436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 909/1837] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:30.338495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:30.339051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:30.345197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:30.345639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:30.346399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:30.346825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:30.408517 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:30.416800 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cd590ef8-2856-428d-ad04-a23e0882405d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082032 Nov 09 05:26:30.417365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 929/1838] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:31.432965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:31.433560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:31.439821 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:31.440295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:31.441055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:31.441486 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:31.499767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:31.507743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-89015e9f-3c87-40ee-87d2-7b0a64d1cc9b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078348 Nov 09 05:26:31.508327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 910/1839] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:31.664100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:26:31.664280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:26:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:26:32.524305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:32.524909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:32.531085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:32.531533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:32.532332 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:32.532766 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:32.590933 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:32.598644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e2b77353-fa28-4e90-a8e5-5c7a9ec5561c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078122 Nov 09 05:26:32.599722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 930/1840] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:33.615546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:33.616172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:33.622427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:33.622865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:33.623637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:33.624065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:33.682413 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:33.690027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fa7e4e61-f990-4345-ad98-2593b6bc3358 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078157 Nov 09 05:26:33.690578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 911/1841] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:34.408812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:26:34.409375 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:26:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:26:34.706110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:34.706639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:34.713523 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:34.713968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:34.714739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:34.715174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:34.773427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:34.781054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ae9b89e2-a0b6-454c-b04f-a1ba3df00ee2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078737 Nov 09 05:26:34.781826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 931/1842] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:35.797546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:35.798156 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:35.805403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:35.805852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:35.806637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:35.807099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:35.865748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:35.873374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f6e06068-d60c-4e7a-9ba5-ed09a2f02c16 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079610 Nov 09 05:26:35.873925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 912/1843] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:36.890013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:36.890627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:36.897426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:36.897871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:36.898641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:36.899073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:36.956738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:36.965159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6132cbc1-5529-41fc-8ad2-da63ce3ba9ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078806 Nov 09 05:26:36.965725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 932/1844] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:37.982010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:37.982595 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:37.988832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:37.989366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:37.990128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:37.990553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:38.051400 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:38.059235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dc313cee-6911-49b9-a899-3e74482bc73d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080873 Nov 09 05:26:38.059863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 913/1845] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:39.075607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:39.076231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:39.082413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:39.082852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:39.083614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:39.084066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:39.142107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:39.149833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c0dbcdd6-e4b9-4734-a753-cbce82ebc636 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077899 Nov 09 05:26:39.150401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 933/1846] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:40.165819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:40.166469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:40.172734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:40.173178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:40.173941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:40.174370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:40.234654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:40.242238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cf49fd67-b89f-438d-be50-a22f1e6eb3e7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080056 Nov 09 05:26:40.242786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 914/1847] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:41.433745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:41.434359 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:41.440140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:41.440594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:41.441371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:41.441804 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:41.500407 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:41.508646 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-95b6f211-87fe-4c6e-b831-97271918b374 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.253722 Nov 09 05:26:41.509219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 934/1848] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:42.525850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:42.526439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:42.532610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:42.533049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:42.533801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:42.534225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:42.592219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:42.600185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d5257205-29b1-46a8-b6af-30ac2207149a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078282 Nov 09 05:26:42.600783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 915/1849] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:43.617812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:43.618413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:43.626952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:43.626952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:43.626952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:43.626952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:43.691781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:43.699604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3cec9c43-fec4-4537-8c44-cd721e92bdae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.086066 Nov 09 05:26:43.700182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 935/1850] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:44.715426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:44.716066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:44.722274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:44.722715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:44.723536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:44.724006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:44.781809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:44.789458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d6fe9ad3-b5b7-421d-a353-68c54d359d89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077656 Nov 09 05:26:44.790026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 916/1851] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:45.806250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:45.806861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:45.813151 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:45.813594 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:45.814358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:45.814787 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:45.876117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:45.886525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f14ebe11-54cb-41cf-b2c2-119de52262fe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084480 Nov 09 05:26:45.887098 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 936/1852] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:46.903530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:46.904192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:46.910391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:46.911353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:46.912139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:46.912569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:46.970424 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:46.978699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f6932276-5666-4374-a8f3-665ceae76baf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078838 Nov 09 05:26:46.979261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 917/1853] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:47.995173 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:47.995806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:48.002041 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:48.002490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:48.003259 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:48.003721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:48.061679 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:48.070140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d42efc52-1dd1-4cec-aac3-0c8a4bdaf9a4 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078447 Nov 09 05:26:48.071108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 937/1854] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:49.085926 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:49.086554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:49.092830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:49.093277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:49.094042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:49.094477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:49.152257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:49.159838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8dd4fd90-b750-45bf-8743-f893065e74af tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077511 Nov 09 05:26:49.160402 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 918/1855] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:50.177425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:50.178014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:50.184256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:50.184694 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:50.185461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:50.185889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:50.244788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:50.252388 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ec7a43ec-4f88-45e6-8f69-453208e2cfe6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078649 Nov 09 05:26:50.252950 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 938/1856] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:51.268211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:51.268812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:51.275063 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:51.275512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:51.276321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:51.276758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:51.337153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:51.345059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e4fa0368-24ce-4086-9d76-20f1acb59e50 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080534 Nov 09 05:26:51.345636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 919/1857] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:52.362203 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:52.362805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:52.369529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:52.369979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:52.370753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:52.371188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:52.429438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:52.437076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2de98636-2772-435b-b8eb-0cf8e95cef8a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078647 Nov 09 05:26:52.437639 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 939/1858] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:53.454011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:53.454598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:53.461377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:53.461812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:53.462559 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:53.462980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:53.520051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:53.528088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e734bf2c-bf88-47a0-ae57-31998ae7ba1d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077710 Nov 09 05:26:53.528647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 920/1859] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:54.543777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:54.544412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:54.550751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:54.551724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:54.552500 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:54.552934 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:54.610417 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:54.618725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4a5f9db4-75a5-4646-a6a8-df8a5896eb3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078621 Nov 09 05:26:54.619289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 940/1860] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:55.634935 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:55.635607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:55.641807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:55.642521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:55.643278 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:55.643743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:55.701247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:55.709469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-74d427e6-1bbf-4ff8-9944-508f5cdc89a8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078173 Nov 09 05:26:55.710052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 921/1861] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:56.725779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:56.726438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:56.732436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:56.732896 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:56.733676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:56.734111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:56.742757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:56.743641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:56.750322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:56.750824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:56.751884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:56.752479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:56.766796 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] HTTP exception thrown: Instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd could not be found. Nov 09 05:26:56.767388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Returning 404 to user: Instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:26:56.768223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c271684b-1a04-4e9c-8449-582065faa988 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "DELETE /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 404 len: 111 microversion: 2.1 time: 0.029717 Nov 09 05:26:56.768754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 922/1862] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:26:56 2021] DELETE /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:26:56.776136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:56.776678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] [instance: 034e3bd9-12b1-44b8-b263-15cd6de07fcd] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:56.783175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:56.783611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:56.784420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:56.784851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:56.798674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] HTTP exception thrown: Instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd could not be found. Nov 09 05:26:56.799301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] Returning 404 to user: Instance 034e3bd9-12b1-44b8-b263-15cd6de07fcd could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:26:56.800225 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c0f32047-ff73-4fb5-ae51-fc84e814c313 tempest-AttachVolumeShelveTestJSON-1450392396 tempest-AttachVolumeShelveTestJSON-1450392396-project] 10.222.0.41 "GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd" status: 404 len: 111 microversion: 2.1 time: 0.027429 Nov 09 05:26:56.803755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 923/1863] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:56 2021] GET /compute/v2.1/servers/034e3bd9-12b1-44b8-b263-15cd6de07fcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 05:26:56.806495 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:56.814788 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-af1db48b-097d-4f8e-9948-16e4e9ed5bf3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.092606 Nov 09 05:26:56.815663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 941/1864] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:57.831990 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:57.833294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:57.839705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:57.840154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:57.840921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:57.841356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:57.927903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:57.935724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e6ff8ba1-6bbc-4dd4-9f54-56145d8ac75e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.107326 Nov 09 05:26:57.936295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 924/1865] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:26:58.954888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:26:58.955685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:26:58.963637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:58.964191 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:58.965149 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:26:58.965472 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:26:59.066813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:26:59.074652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b363b66f-10d3-4623-bec7-975e2f3ba417 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.125355 Nov 09 05:26:59.075226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 942/1866] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:26:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:27:00.092735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:00.093411 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:00.101077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:00.101628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:00.102523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:00.103024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:00.170462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:00.177753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-691caed0-da21-42e5-936e-77cea99e9c9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.089065 Nov 09 05:27:00.178363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 925/1867] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:27:01.194168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:01.194773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:01.196886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d8082b23-c8bc-4ba0-bf7d-1e4f06b9779d tempest-VolumesSnapshotsTestJSON-1219126447 tempest-VolumesSnapshotsTestJSON-1219126447-project] Action: 'create', calling method: .version_select at 0x7f30bfd8c1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-158875997"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:27:01.201097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:01.201542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:01.202313 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:01.202745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:01.261330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:01.269176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e7b9c4d7-0de9-4ed3-aa4e-bc77339122aa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078848 Nov 09 05:27:01.270442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 926/1868] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:01.905178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:27:01.905432 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:27:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.41) !!! Nov 09 05:27:02.288270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:02.288813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:02.295039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:02.295484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:02.296283 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:02.296711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:02.354716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:02.362341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1a938eb9-90a6-4813-8167-b346dee23388 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077798 Nov 09 05:27:02.362913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 927/1869] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:03.379730 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:03.380343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:03.386495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:03.386925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:03.387707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:03.388132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:03.445350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:03.453393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c4a230dc-9987-4a8d-9be8-64803ebea07c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077642 Nov 09 05:27:03.453962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 928/1870] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:04.195980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:27:04.196140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:27:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:27:04.470004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:04.470715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:04.476792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:04.477237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:04.478048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:04.478476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:04.539585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:04.547177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-da9352b6-170a-4ad6-bf04-a59e160308bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080780 Nov 09 05:27:04.547764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 929/1871] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:05.564220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:05.564862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:05.570860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:05.571302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:05.572094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:05.572521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:05.632783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:05.640353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f419aba9-3ac9-4635-8dd3-f8a6aff7f8be tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079814 Nov 09 05:27:05.640912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 930/1872] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:06.656812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:06.657459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:06.663629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:06.664083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:06.664872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:06.665297 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:06.725250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:06.732957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c91105d1-820c-4735-8eb8-4437a972f03d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079810 Nov 09 05:27:06.733518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 931/1873] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:07.749822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:07.750547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:07.757495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:07.757936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:07.758686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:07.759110 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:07.817736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:07.825392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d8d30bb3-c2d7-4759-8c9d-c2472ae81923 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079195 Nov 09 05:27:07.825887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 932/1874] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:08.842510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:08.843058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:08.850059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:08.850502 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:08.851301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:08.851764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:08.908309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:08.916544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c5c7b980-7ef8-47da-956b-758c5522b2e6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077762 Nov 09 05:27:08.917111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 933/1875] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:09.932787 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:09.933453 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:09.939639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:09.940082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:09.940832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:09.941304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:09.999830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:10.007585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aa83ac75-e36c-47f5-9889-984345b1fc95 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078444 Nov 09 05:27:10.008162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 934/1876] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:11.023856 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:11.024501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:11.030747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:11.031186 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:11.031982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:11.032417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:11.089752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:11.097360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8728fda6-ed8d-4612-a7a4-aa2fe9dd7986 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077124 Nov 09 05:27:11.097925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 935/1877] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:12.113783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:12.114476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:12.120559 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:12.120998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:12.121751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:12.122173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:12.183563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:12.191767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cacaebbd-ab7e-4eab-a357-07b88ba4c3d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081141 Nov 09 05:27:12.192325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 936/1878] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:13.208739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:13.209420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:13.215473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:13.215943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:13.216696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:13.217119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:13.275071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:13.282633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a1f061e2-a2f7-45d7-a92a-fa4f85108b09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078104 Nov 09 05:27:13.283188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 937/1879] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:14.299666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:14.300352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:14.306961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:14.307396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:14.308177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:14.308601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:14.370143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:14.378050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9eef985e-2cb3-44e3-bdeb-d0d491a13688 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082076 Nov 09 05:27:14.378631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 938/1880] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:15.394134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:15.394842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:15.400937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:15.401375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:15.402130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:15.402551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:15.460678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:15.468302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dbb4fe94-20b4-4b57-bc18-4e7bd1a6fb53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077839 Nov 09 05:27:15.468853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 939/1881] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:16.485578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:16.486275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:16.492915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:16.493356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:16.494111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:16.494534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:16.552466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:16.560337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-23ff6b5a-ec50-4a0f-9d7d-385e68fadde7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078425 Nov 09 05:27:16.560906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 940/1882] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:17.580473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:17.581139 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:17.588048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:17.588495 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:17.589263 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:17.589694 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:17.648429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:17.656095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7c9d3204-52a4-42e7-9858-17c34ef3d310 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079313 Nov 09 05:27:17.656669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 941/1883] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:18.672393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:18.672983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:18.679179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:18.679712 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:18.680477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:18.680905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:18.741453 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:18.749134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e96700c2-c2cc-4d99-af61-5b6ab7314d55 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080499 Nov 09 05:27:18.749702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 942/1884] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:19.768262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:19.769592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:19.775811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:19.776254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:19.777140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:19.777890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:19.838175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:19.845995 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c885aa5f-7de8-446a-85ed-21564e17b2c7 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081399 Nov 09 05:27:19.846558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 943/1885] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:20.862001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:20.862531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:20.868805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:20.869248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:20.870008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:20.870439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:20.928639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:20.936500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-99b9648a-1022-44cf-9334-12a72f9b2a3d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078230 Nov 09 05:27:20.937052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 944/1886] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:21.952936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:21.953601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:21.959793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:21.960230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:21.960991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:21.961416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:22.019464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:22.027014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-01468f45-a4f6-4b19-a499-ca90b3a2300c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077765 Nov 09 05:27:22.027570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 945/1887] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:23.043841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:23.044436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:23.050621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:23.051059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:23.051841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:23.052265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:23.109238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:23.116858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f52e28f4-c0f4-47b2-ade8-0713f2116bcf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.076637 Nov 09 05:27:23.117412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 946/1888] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:24.133977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:24.134668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:24.140770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:24.141211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:24.141969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:24.142392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:24.200987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:24.210237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-61789e4c-9525-4e38-a0dc-46ee63756d27 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079922 Nov 09 05:27:24.210797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 947/1889] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:25.227507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:25.228250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:25.234367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:25.234802 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:25.235554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:25.236024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:25.297243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:25.305440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f2aaf9b3-e073-498f-bfff-591833bc716f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081630 Nov 09 05:27:25.306000 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 948/1890] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:26.322874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:26.324405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:26.331904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:26.332654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:26.333939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:26.334413 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:26.392464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:26.400083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c125e107-25ea-4d56-8b18-9866fe428de9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081239 Nov 09 05:27:26.400653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 949/1891] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:27.417133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:27.417828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:27.424150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:27.424598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:27.425970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:27.426399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:27.484332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:27.491863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b5db5a66-d397-40c3-b198-191b6ce8988d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078330 Nov 09 05:27:27.492420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 950/1892] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:28.511673 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:28.512327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:28.518537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:28.518979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:28.519771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:28.520210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:28.580294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:28.587986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2814d6d4-8de3-4464-aeca-9e3ff9b84667 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082485 Nov 09 05:27:28.588546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 951/1893] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:29.604844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:29.605443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:29.611573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:29.612042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:29.612852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:29.613275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:29.670513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:29.678567 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-21dc601f-5e16-456e-b287-2e3cd210332c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077351 Nov 09 05:27:29.679127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 952/1894] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:30.694200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:30.694852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:30.700939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:30.701373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:30.702128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:30.702554 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:30.760309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:30.768215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b287918b-f0d5-4b19-b8d8-e04d42579ce2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077819 Nov 09 05:27:30.769388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 953/1895] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:31.785583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:31.786232 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:31.792289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:31.792724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:31.793477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:31.793904 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:31.853927 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:31.861577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5640afd7-c2cc-415f-aa82-35398e303c24 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080297 Nov 09 05:27:31.862143 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 954/1896] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:32.878335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:32.879220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:32.885410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:32.885851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:32.886631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:32.887076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:32.944094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:32.951670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e215201f-79ac-4fdb-9102-f59028e6926b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077049 Nov 09 05:27:32.952228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 955/1897] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:33.968630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:33.969330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:33.975395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:33.975868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:33.976625 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:33.977050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:34.034475 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:34.041934 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7f6db4af-940f-4cdd-8115-33fc55c4bab0 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.076979 Nov 09 05:27:34.042487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 956/1898] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:35.058314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:35.058977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:35.064853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:35.065324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:35.066093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:35.066521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:35.123613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:35.131508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d91901a8-f8c5-4c51-826a-f3a64aaa1fba tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.076931 Nov 09 05:27:35.132098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 957/1899] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:36.148483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:36.149180 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:36.155387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:36.155860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:36.156628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:36.157060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:36.214783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:36.222559 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-542995a0-28ae-4470-b8b9-d31cbcfe1385 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077784 Nov 09 05:27:36.223120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 958/1900] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:37.238809 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:37.239508 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:37.245633 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:37.246074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:37.246829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:37.247255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:37.304517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:37.311960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-19bd235b-fddf-4d01-ad08-3226aa88592d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.076792 Nov 09 05:27:37.312512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 959/1901] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:38.328347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:38.329043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:38.335134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:38.335577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:38.336384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:38.336812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:38.397410 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:38.405057 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bce04613-74d0-42da-ac68-3cfc522e7f01 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080340 Nov 09 05:27:38.405629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 960/1902] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:39.422017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:39.422629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:39.429396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:39.429847 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:39.430613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:39.431048 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:39.488993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:39.496763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8a8d821d-e60f-4e3d-92e6-ee0d8502cff5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078473 Nov 09 05:27:39.497328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 961/1903] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:40.513393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:40.514096 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:40.520293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:40.520732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:40.521498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:40.521930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:40.581423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:40.589866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-39dad71c-d587-4b35-9a39-5af29c47fd3f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080141 Nov 09 05:27:40.590429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 962/1904] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:41.606346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:41.607009 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:41.613362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:41.613805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:41.614572 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:41.615004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:41.672869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:41.681023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6f69f5f2-0f1f-4767-871c-f68a3ad02d2d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078403 Nov 09 05:27:41.681590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 963/1905] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:42.696812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:42.697408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:42.703714 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:42.704161 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:42.704925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:42.705352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:42.762690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:42.770883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2396f6cb-541f-4008-acef-190b1e277940 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077740 Nov 09 05:27:42.771443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 964/1906] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:43.787456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:43.788091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:43.794309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:43.794749 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:43.795510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:43.795968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:43.853361 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:43.860923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-009fb2b6-1b88-4f94-91fb-dd0462ac76d8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077125 Nov 09 05:27:43.861481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 965/1907] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:44.877319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:44.879116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:44.887392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:44.887874 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:44.888644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:44.889076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:44.949718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:44.957366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-72a22581-1e2c-4931-843d-7474c3c0029e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.083790 Nov 09 05:27:44.957929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 966/1908] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:45.974070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:45.974771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:45.980898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:45.981343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:45.982108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:45.982545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:46.041533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:46.049158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-510eed29-c7c5-4257-8773-79b71ac44c64 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078804 Nov 09 05:27:46.049716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 967/1909] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:47.065264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:47.065939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:47.072210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:47.072590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:47.073353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:47.073779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:47.133323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:47.140873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-474aa505-2b8d-4a9d-9ef7-79680a338d9d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079264 Nov 09 05:27:47.141431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 968/1910] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:48.157734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:48.158405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:48.165079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:48.165523 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:48.166284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:48.166714 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:48.224466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:48.232019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bb44dfae-ad19-4da0-92f5-c16d0ac9d8f8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077904 Nov 09 05:27:48.232582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 969/1911] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:49.248959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:49.249622 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:49.256006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:49.256445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:49.257228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:49.257653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:49.315698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:49.323199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-610df431-b778-48b2-8bd0-688058ac1b0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077899 Nov 09 05:27:49.323780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 970/1912] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:50.340342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:50.341030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:50.347103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:50.347549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:50.348348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:50.348786 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:50.406099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:50.413913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5e3ef002-b450-472d-9a63-f7793ad58bd9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.076939 Nov 09 05:27:50.414471 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 971/1913] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:51.430827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:51.431488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:51.437645 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:51.438083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:51.438835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:51.439257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:51.731208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:51.738974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0c45e0f6-0a60-4e01-ad15-9ae2a1ddf865 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.311813 Nov 09 05:27:51.739533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 972/1914] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:52.755488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:52.756157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:52.762353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:52.762793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:52.763549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:52.764003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:52.821229 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:52.828632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5f9e44a1-6822-4de7-99c3-138bfd5235ef tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077070 Nov 09 05:27:52.829192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 973/1915] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:53.845136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:53.845776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:53.852438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:53.852875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:53.853628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:53.854053 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:53.911729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:53.919252 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-06ab7a9f-68ec-4f21-8a0a-846905f7584a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077836 Nov 09 05:27:53.919838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 974/1916] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:54.935668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:54.936304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:54.942947 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:54.943385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:54.944166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:54.944593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:55.001273 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:55.009716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c88dc555-dfcf-4ee4-8671-c5f608bcf20d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077782 Nov 09 05:27:55.010271 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 975/1917] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:56.026010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:56.026643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:56.032791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:56.033234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:56.034604 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:56.035033 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:56.094664 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:56.102988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-32dd60d8-34bb-4596-b26b-620593a6bc1b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080624 Nov 09 05:27:56.103558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 976/1918] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:57.119805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:57.120534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:57.126560 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:57.127028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:57.127803 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:57.128241 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:57.186406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:57.194082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1d94222f-4010-4cbd-ba3f-8b0b7eb37cae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078128 Nov 09 05:27:57.194637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 977/1919] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:58.209827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:58.210533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:58.216833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:58.217274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:58.218039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:58.218463 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:58.277917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:58.285436 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ddf0491d-d8a1-4127-8521-ef09244eefbc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079228 Nov 09 05:27:58.285982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 978/1920] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:59.301818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:59.302509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:59.308676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:59.309119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:59.309882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:59.310310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:59.367972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:27:59.375529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-651ec8bc-c650-4465-8286-8eda1845a219 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077439 Nov 09 05:27:59.376119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 979/1921] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:27:59.767769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:59.768265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:59.774528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:59.775016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:59.775824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:59.776319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:59.790363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] HTTP exception thrown: Instance 3a3364cb-1695-4329-82ff-d4e26da28b73 could not be found. Nov 09 05:27:59.790945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Returning 404 to user: Instance 3a3364cb-1695-4329-82ff-d4e26da28b73 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:27:59.791795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-538b26f7-41c7-4a4a-9172-b8d220449b9c tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 404 len: 111 microversion: 2.1 time: 0.028445 Nov 09 05:27:59.792319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 980/1922] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:27:59 2021] DELETE /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:27:59.800196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:27:59.800946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] [instance: 3a3364cb-1695-4329-82ff-d4e26da28b73] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:27:59.806639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:59.807087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:59.807877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:27:59.808305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:27:59.821478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] HTTP exception thrown: Instance 3a3364cb-1695-4329-82ff-d4e26da28b73 could not be found. Nov 09 05:27:59.821988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] Returning 404 to user: Instance 3a3364cb-1695-4329-82ff-d4e26da28b73 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:27:59.822791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-491ce63d-b66a-423f-9110-c41e268e4b11 tempest-AttachVolumeTestJSON-1073527850 tempest-AttachVolumeTestJSON-1073527850-project] 10.222.0.41 "GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73" status: 404 len: 111 microversion: 2.1 time: 0.026456 Nov 09 05:27:59.823300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 981/1923] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:27:59 2021] GET /compute/v2.1/servers/3a3364cb-1695-4329-82ff-d4e26da28b73 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:28:00.392364 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:00.393788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:00.400685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:00.401181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:00.401999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:00.402386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:00.478822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:00.486386 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3acbc9cf-f7c3-470f-ac9f-29fec8189434 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.097638 Nov 09 05:28:00.486938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 982/1924] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:01.502685 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:01.504304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:01.512432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:01.512920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:01.513715 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:01.514150 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:01.589134 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:01.606175 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-83f74024-c6e1-4775-941b-09741b34cda8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.106912 Nov 09 05:28:01.607706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 983/1925] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:02.624070 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:02.624733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:02.632608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:02.633264 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:02.634116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:02.634623 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:02.730469 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:02.740552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-28ba1c6e-8a43-4d5b-b3e7-7ea0d696b7ee tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.120224 Nov 09 05:28:02.741226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 984/1926] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:03.756398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:03.757052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:03.763167 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:03.763608 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:03.764398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:03.764827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:03.825791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:03.834015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4992e8ec-ba02-44e3-81b5-7c2bf54656cc tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081539 Nov 09 05:28:03.834583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 985/1927] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:03 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:04.852317 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:04.853051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:04.859159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:04.859742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:04.860512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:04.860941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:04.920422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:04.928602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-27e12a49-002d-4cb7-8466-9449d0399925 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080002 Nov 09 05:28:04.929168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 986/1928] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:05.945105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:05.945774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:05.951666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:05.952122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:05.952890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:05.953334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:06.015304 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:06.023723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c174a873-652c-4747-81eb-eaeb1ef98ee5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082407 Nov 09 05:28:06.024290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 987/1929] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:07.040055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:07.040705 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:07.046888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:07.047333 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:07.048121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:07.048550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:07.108890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:07.117190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f2fe1992-6d51-4cee-97d8-57f18c247de3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080810 Nov 09 05:28:07.117763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 988/1930] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:08.133696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:08.134351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:08.140662 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:08.141176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:08.141942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:08.142366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:08.199808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:08.207294 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-86528a70-2ff1-4f0e-bde2-0be648bfacfd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077221 Nov 09 05:28:08.207883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 989/1931] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:09.224316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:09.224984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:09.231005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:09.231443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:09.232316 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:09.232747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:09.289985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:09.297519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ed87fbbf-4170-46e3-a20a-d1ab694d4483 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077390 Nov 09 05:28:09.298078 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 990/1932] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:10.315085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:10.315797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:10.321942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:10.322382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:10.323137 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:10.323562 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:10.380868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:10.388416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c3e3f70c-b8c7-4ccd-b5f8-26da9a9e7586 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077633 Nov 09 05:28:10.388986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 991/1933] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:11.404851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:11.405522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:11.411637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:11.412086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:11.412839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:11.413266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:11.470952 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:11.478781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0de38cb6-f6b5-4e4e-aa5c-c11d0818c23f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077559 Nov 09 05:28:11.479354 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 992/1934] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:11.682500 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:28:11.682668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:28:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:28:12.494914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:12.495599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:12.501860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:12.502300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:12.503324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:12.503779 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:12.561787 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:12.569629 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a1c5fa18-16a9-4736-9445-83ec068565d3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078387 Nov 09 05:28:12.570189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 993/1935] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:13.585920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:13.586546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:13.592797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:13.593243 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:13.594006 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:13.594435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:13.654773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:13.662898 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8b5becd1-d96d-4815-a282-cef87b424acf tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080622 Nov 09 05:28:13.663458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 994/1936] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:14.679814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:14.680395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:14.686601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:14.687036 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:14.687820 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:14.688244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:14.749760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:14.758191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c767c722-cb51-487a-a27f-49f490b56e23 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082002 Nov 09 05:28:14.758745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 995/1937] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:15.774886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:15.775544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:15.781825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:15.782266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:15.783020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:15.783442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:15.843187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:15.850860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e51b9b70-bb5d-4d0e-b210-6ede63ea1eaa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079593 Nov 09 05:28:15.851415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 996/1938] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:15 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:16.867849 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:16.868455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:16.874696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:16.875145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:16.875947 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:16.876384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:16.936344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:16.944102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ce907d7a-aeb6-4468-8016-aa40c8854d79 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079915 Nov 09 05:28:16.944672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 997/1939] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:17.960709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:17.961356 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:17.967520 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:17.967997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:17.968764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:17.969192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:18.030116 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:18.038650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3bf9a426-cdc1-4616-b05d-554d90ba4fd6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081582 Nov 09 05:28:18.039222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 998/1940] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:18.450703 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:28:18.451516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:28:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.41) !!! Nov 09 05:28:19.055367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:19.055993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:19.062227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:19.062669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:19.063438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:19.063895 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:19.121286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:19.129600 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3b4d1e59-4e13-4660-87f1-ea2ba522539c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077892 Nov 09 05:28:19.130154 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 999/1941] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:20.146447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:20.147131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:20.153211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:20.153647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:20.154403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:20.154823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:20.217707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:20.226067 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8449a7fc-bce3-4b1f-a6ec-50a10675259d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.083809 Nov 09 05:28:20.226700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1000/1942] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:21.242019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:21.242658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:21.248900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:21.249342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:21.250102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:21.250532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:21.308289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:21.316262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-128b20fe-9ae6-4c20-a739-524f63e3e793 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077899 Nov 09 05:28:21.316832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1001/1943] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:22.333302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:22.333957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:22.340214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:22.340666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:22.341437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:22.341870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:22.399377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:22.406980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-350a9b15-bef1-4231-b58f-0f4018371d35 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077934 Nov 09 05:28:22.407542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1002/1944] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:23.426929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:23.427589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:23.433878 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:23.434323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:23.435085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:23.435516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:23.493928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:23.501535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d4fc3149-af3a-4476-b86e-59298b83a1ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078239 Nov 09 05:28:23.502102 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1003/1945] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:24.518329 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:24.519033 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:24.525179 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:24.525624 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:24.526390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:24.526824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:24.585302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:24.593004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-15e86097-f559-45e8-88b0-15afb5000c43 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078323 Nov 09 05:28:24.593573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1004/1946] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:25.609374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:25.610010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:25.616251 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:25.616693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:25.617456 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:25.617882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:25.676843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:25.684407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7879b958-d266-4762-bf0c-78e2090c1afe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078683 Nov 09 05:28:25.684967 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1005/1947] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:26.701287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:26.701892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:26.708658 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:26.709100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:26.709860 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:26.710288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:26.770533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:26.778136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2f78ccd0-eb0c-465c-982f-df8e92e54130 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080501 Nov 09 05:28:26.778686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1006/1948] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:27.795293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:27.796077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:27.802109 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:27.802551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:27.803315 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:27.803775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:27.861482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:27.869239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0b38261-5647-43ec-8b5d-26ea5b5cf645 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077576 Nov 09 05:28:27.869813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1007/1949] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:27 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:28.885959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:28.886573 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:28.892843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:28.893290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:28.894568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:28.895005 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:28.952393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:28.960543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1225e4be-7f78-4cc2-b474-c4f7db208fc9 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078259 Nov 09 05:28:28.961142 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1008/1950] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:29.977681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:29.978300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:29.984531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:29.984974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:29.985739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:29.986171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:30.056963 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:30.069039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-567e9716-e156-40f3-b8b2-a9ebf262160a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.094771 Nov 09 05:28:30.069894 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1009/1951] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:31.085840 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:31.086501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:31.092811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:31.093205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:31.093965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:31.094394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:31.152884 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:31.161149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d194370d-6840-4406-a172-dd767089c623 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078928 Nov 09 05:28:31.161707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1010/1952] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:32.178255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:32.178964 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:32.185325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:32.185771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:32.186522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:32.186946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:32.244961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:32.252454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-93734a31-85a1-4818-921a-7c311e4dde69 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078433 Nov 09 05:28:32.253914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1011/1953] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:33.269710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:33.270391 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:33.276479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:33.276924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:33.277686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:33.278119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:33.338451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:33.346084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a9bbace4-3e54-4340-b345-99a4bbf36b75 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080056 Nov 09 05:28:33.346647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1012/1954] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:34.362285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:34.363482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:34.369707 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:34.370148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:34.370912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:34.371346 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:34.429499 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:34.437133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9d4ce49b-2e68-4cac-81d8-8692f83a8dd8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078537 Nov 09 05:28:34.437692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1013/1955] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:35.457720 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:35.458392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:35.464182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:35.464621 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:35.465374 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:35.465799 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:35.523688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:35.531234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1ac71f22-9287-4c0b-872a-6d7efe5e50bd tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077818 Nov 09 05:28:35.531824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1014/1956] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:36.547600 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:36.548303 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:36.555236 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:36.555701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:36.556470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:36.556900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:36.615132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:36.622816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-70c8cbf0-4a17-44e2-b07d-1983aab99830 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078856 Nov 09 05:28:36.623375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1015/1957] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:37.640192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:37.640801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:37.646992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:37.647437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:37.648292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:37.648721 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:37.707747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:37.715388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dfb19587-f2f8-4e6b-9e0a-42cc39015b53 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078882 Nov 09 05:28:37.715971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1016/1958] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:38.732331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:38.732971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:38.739145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:38.739590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:38.740378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:38.740808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:38.798525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:38.806204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-06b069da-5db9-4480-9810-0d6ec3945712 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077572 Nov 09 05:28:38.806755 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1017/1959] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:39.822128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:39.822965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:39.828901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:39.829328 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:39.830091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:39.830511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:39.892026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:39.899553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9d46b7e5-248b-4a2e-9383-c23f3534a4e5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081191 Nov 09 05:28:39.900131 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1018/1960] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:39 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:40.915343 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:40.915992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:40.922219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:40.922660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:40.923420 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:40.923873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:40.981377 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:40.989516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0a189d1-2c27-432f-a365-c9ccd43f9539 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077816 Nov 09 05:28:40.990075 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1019/1961] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:42.006706 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:42.007396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:42.013509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:42.013945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:42.014697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:42.015123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:42.072701 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:42.080352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2edb1501-6b0a-436b-828d-1b12abe9034b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078030 Nov 09 05:28:42.081585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1020/1962] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:43.097576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:43.098217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:43.104285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:43.104731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:43.105482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:43.105906 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:43.165518 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:43.173123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b9bdce09-6662-4a48-9e8c-56c6d6e7fbb2 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079288 Nov 09 05:28:43.173680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1021/1963] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:44.189830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:44.191703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:44.197959 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:44.198394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:44.199160 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:44.199590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:44.262145 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:44.270125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d005124c-7bc8-4537-b629-829ec8ce2e2b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.083983 Nov 09 05:28:44.271144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1022/1964] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:45.285970 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:45.286656 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:45.292946 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:45.293396 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:45.294165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:45.294601 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:45.351930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:45.359530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d5b2ea3e-7330-48f9-886b-047ff3efdf89 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077235 Nov 09 05:28:45.360121 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1023/1965] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:46.376787 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:46.377709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:46.383902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:46.384347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:46.385113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:46.385548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:46.446615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:46.454285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-86e21a6e-d529-41d0-bdf2-62440c7f5c87 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081275 Nov 09 05:28:46.454859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1024/1966] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:47.471128 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:47.471846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:47.478487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:47.478933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:47.479741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:47.480177 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:47.537767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:47.545327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9c9d32b5-810b-4893-84ba-f048dcc46cfe tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077894 Nov 09 05:28:47.545892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1025/1967] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:48.561920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:48.562615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:48.569326 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:48.570152 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:48.570510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:48.570932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:48.628401 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:48.636491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4e6e1aa4-be88-476c-96ae-daec569d78c5 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078189 Nov 09 05:28:48.637321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1026/1968] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:49.653082 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:49.653703 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:49.659930 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:49.660370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:49.661122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:49.661547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:49.718939 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:49.726476 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-78719a19-cd71-4cb4-8068-fecfd04be9bb tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077040 Nov 09 05:28:49.727035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1027/1969] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:50.743235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:50.743891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:50.750199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:50.750643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:50.751405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:50.751868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:50.810407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:50.818069 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c7ff1145-f085-4af8-8125-3a4870c10848 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078488 Nov 09 05:28:50.818638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1028/1970] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:51.835047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:51.835691 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:51.841810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:51.842261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:51.843018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:51.843445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:51.901166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:51.908700 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-58aedcbe-bf8b-4a07-8760-9b83d772303e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078011 Nov 09 05:28:51.909260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1029/1971] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:51 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:52.925211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:52.925858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:52.932310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:52.932758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:52.933530 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:52.933961 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:52.994998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:53.002824 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ddbee1c4-008b-48f6-816f-fe5901d69a09 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080998 Nov 09 05:28:53.003384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1030/1972] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:54.020094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:54.020778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:54.026865 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:54.027311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:54.028107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:54.028537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:54.086186 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:54.094024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b2cfbd27-56dd-44e9-a8a1-81c65dc5bb85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078256 Nov 09 05:28:54.094591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1031/1973] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:55.110362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:55.110972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:55.117130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:55.117582 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:55.118319 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:55.118739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:55.325302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:55.334077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5dcf313e-e55b-4d5c-bfcc-d8552506b38f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.227277 Nov 09 05:28:55.335889 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1032/1974] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:56.349869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:56.350546 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:56.356649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:56.357087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:56.357840 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:56.358272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:56.418042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:56.425735 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e1daa3ac-9990-40b2-89a0-62c7bfd4f309 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079573 Nov 09 05:28:56.426290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1033/1975] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:57.014541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d8082b23-c8bc-4ba0-bf7d-1e4f06b9779d tempest-VolumesSnapshotsTestJSON-1219126447 tempest-VolumesSnapshotsTestJSON-1219126447-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 115.927353 Nov 09 05:28:57.015170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 943/1976] 10.222.0.41 () {60 vars in 1154 bytes} [Tue Nov 9 05:27:01 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 115929 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 09 05:28:57.443337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:57.443995 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:57.450195 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:57.450647 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:57.451423 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:57.451941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:57.523491 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:57.532683 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eed5841c-4f7d-429f-93f7-d6c006406d7f tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.093594 Nov 09 05:28:57.533405 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1034/1977] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:28:58.555705 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:58.556833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:58.562780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:58.563231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:58.564035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:58.564475 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:58.623234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:58.631772 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-35cc5ace-cf3e-4fd5-8e6b-19ef2bfb8081 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081015 Nov 09 05:28:58.632351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 944/1978] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:58 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:28:59.648563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:28:59.649159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:28:59.655355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:59.655828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:59.656578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:28:59.657003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:28:59.714598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:28:59.722914 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6ed26828-92b7-4cbc-8f85-09cd334ee9df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077377 Nov 09 05:28:59.723473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1035/1979] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:28:59 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:00.739825 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:00.740389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:00.746603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:00.747048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:00.747858 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:00.748290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:00.806323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:00.813959 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-14723687-f461-4bd2-abfe-1be40e8a7b4d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078698 Nov 09 05:29:00.814522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 945/1980] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:00 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:01.830011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:01.830552 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:01.837237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:01.837677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:01.838455 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:01.838875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:01.899768 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:01.907284 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0e2425c2-98a5-4af4-8869-75085755c2c8 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080994 Nov 09 05:29:01.907862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1036/1981] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:01 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:02.923567 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:02.924202 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:02.930424 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:02.930867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:02.931648 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:02.932076 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:02.989731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:02.997225 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fa2b5bdb-2879-4f14-8828-8b38ead347ea tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077286 Nov 09 05:29:02.997782 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 946/1982] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:02 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:04.014657 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:04.016545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:04.025325 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:04.025774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:04.026543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:04.027068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:04.087370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:04.095054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fc09a34a-8e20-4980-83fc-401cb263e4df tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.084159 Nov 09 05:29:04.095607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1037/1983] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:04 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:05.112050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:05.112583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:05.118818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:05.119267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:05.120077 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:05.120510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:05.179687 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:05.187357 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f836d9ae-3d2b-40fe-8d8a-4c5aec171ed3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079095 Nov 09 05:29:05.187974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 947/1984] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:05 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:06.203933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:06.204541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:06.211061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:06.211509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:06.212308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:06.212743 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:06.270641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:06.278230 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9757d918-b219-4a38-b021-c3ddd2ae215b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078030 Nov 09 05:29:06.278801 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1038/1985] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:06 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:07.294660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:07.295234 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:07.301940 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:07.302382 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:07.303137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:07.303568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:07.360348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:07.368465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-92f1daa7-5f64-421a-8d57-090cf31e05b6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077439 Nov 09 05:29:07.369000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 948/1986] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:07 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:08.385018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:08.385631 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:08.391837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:08.392275 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:08.393025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:08.393447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:08.450788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:08.459051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-67111580-e091-4ed0-963b-142a09c68fa6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077663 Nov 09 05:29:08.459606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1039/1987] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:08 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:09.475946 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:09.476534 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:09.482988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:09.483426 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:09.484230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:09.484659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:09.545477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:09.553839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b8e02982-40ee-40e2-ab85-98afc9a038e1 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082165 Nov 09 05:29:09.554407 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 949/1988] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:09 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:10.570287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:10.570886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:10.577170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:10.577605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:10.578353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:10.578776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:10.637353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:10.644888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-50e58841-6b3a-48e6-88fe-d1c7df1bde96 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078241 Nov 09 05:29:10.645445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1040/1989] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:10 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:11.661208 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:11.661816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:11.668116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:11.668564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:11.669340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:11.669776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:11.731785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:11.739635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-eb8c6b73-9592-4cbf-a57d-01b9eabec6c6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082675 Nov 09 05:29:11.740196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 950/1990] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:11 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:12.756830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:12.757431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:12.763775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:12.764223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:12.764983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:12.765415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:12.823173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:12.831488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-214bdf73-880f-4c90-9818-66f77c132c94 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078227 Nov 09 05:29:12.832126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1041/1991] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:12 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:13.848162 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:13.848713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:13.855096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:13.855540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:13.856343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:13.856775 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:13.914995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:13.922558 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5df8d389-7097-49eb-b1cc-5b66aafbf477 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078199 Nov 09 05:29:13.923113 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 951/1992] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:13 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:14.938637 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:14.939247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:14.946163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:14.946613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:14.947375 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:14.947836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:15.009124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:15.016782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-14d5b03e-48b8-463b-9555-71af5fddc50c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081791 Nov 09 05:29:15.017344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1042/1993] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:14 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:16.033339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:16.033980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:16.040281 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:16.040722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:16.041485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:16.041912 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:16.099936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:16.107585 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a8715d31-09c9-459d-9459-d33714670a38 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077977 Nov 09 05:29:16.108174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 952/1994] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:16 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:17.124687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:17.125235 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:17.132418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:17.132897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:17.133665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:17.134101 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:17.192564 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:17.200194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-337e5ef3-9dfc-4fd3-a96e-10e828fa2b9e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079322 Nov 09 05:29:17.200758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1043/1995] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:17 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:18.216342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:18.216938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:18.223197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:18.223662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:18.224439 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:18.224868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:18.282179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:18.289799 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4a5da080-03b0-4932-9d56-f8de09841f31 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077158 Nov 09 05:29:18.290354 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 953/1996] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:18 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:19.305936 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:19.306605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:19.312676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:19.313112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:19.313867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:19.314289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:19.377997 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:19.385741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2faf2abb-4ff9-46b2-95be-c19d37dc8ffa tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.083435 Nov 09 05:29:19.386302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1044/1997] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:19 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:20.402657 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:20.403256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:20.409535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:20.409980 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:20.410753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:20.411186 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:20.468615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:20.476177 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8e6bca8c-71b8-41fc-82f2-97b46a37d255 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077213 Nov 09 05:29:20.476739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 954/1998] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:20 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:21.493087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:21.493684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:21.500104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:21.500540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:21.501291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:21.501980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:21.561531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:21.570122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9ede267b-d401-4130-aeae-fe324c4eaf54 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080653 Nov 09 05:29:21.570886 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1045/1999] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:21 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:22.587303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:22.587985 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:22.594165 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:22.594603 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:22.595367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:22.595829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:22.656685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:22.664909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-14f03b34-5d6d-476a-be02-a85fe0cb9f5c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081270 Nov 09 05:29:22.665465 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 955/2000] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:22 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:23.680833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:23.681437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:23.687921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:23.688363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:23.689153 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:23.689577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:23.747746 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:23.755544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cb27f588-4d46-4855-8e8d-8768120c4bed tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078344 Nov 09 05:29:23.756127 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1046/2001] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:23 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:24.771869 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:24.772467 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:24.778768 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:24.779218 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:24.780024 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:24.780464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:24.838547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:24.846206 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-de1bd8a7-6870-4936-a583-be2d77ee6e6a tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078650 Nov 09 05:29:24.846779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 956/2002] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:24 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:25.862389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:25.862968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:25.869163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:25.869607 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:25.870363 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:25.870793 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:25.929373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:25.937025 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-92455627-d12b-43d2-9cb1-f1b06bcc8177 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078416 Nov 09 05:29:25.937585 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1047/2003] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:25 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:26.953538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:26.954179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:26.960752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:26.961196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:26.961968 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:26.962396 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:27.020891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:27.028421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-56fb4ed4-015e-411f-bd49-0def8976b6e3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078717 Nov 09 05:29:27.028979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 957/2004] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:26 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:28.044924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:28.045553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:28.051996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:28.052437 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:28.053196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:28.053619 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:28.120432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:28.128238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8b704dd5-d116-4cc1-ac3e-0fe3fde8b606 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.086987 Nov 09 05:29:28.128790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1048/2005] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:28 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:29.143864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:29.144449 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:29.150816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:29.151254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:29.152080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:29.152547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:29.211078 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:29.218684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e9002025-2ecf-4a56-8839-0606928062ae tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078476 Nov 09 05:29:29.219240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 958/2006] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:29 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:30.235553 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:30.236212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:30.243015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:30.243652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:30.244474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:30.244901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:30.305543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:30.314147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ea013634-9c76-404c-8327-8b4cbe785305 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.082253 Nov 09 05:29:30.314702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1049/2007] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:30 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:31.331176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:31.331809 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:31.338066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:31.338511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:31.339279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:31.339743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:31.397783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:31.406096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cbc56ce9-99ae-48d4-8953-e923f82cc0b3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078608 Nov 09 05:29:31.406670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 959/2008] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:31 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:32.423060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:32.423680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:32.429852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:32.430295 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:32.431081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:32.431511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:32.489047 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:32.496519 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6fcf8a22-e8a4-4a77-8e27-c041789a17c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077072 Nov 09 05:29:32.497267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1050/2009] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:32 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:33.513386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:33.514019 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:33.520266 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:33.520735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:33.521499 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:33.521930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:33.581155 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:33.588920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0b2b2100-f4fa-4ee4-a726-aec9252c1e3c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079229 Nov 09 05:29:33.589487 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 960/2010] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:33 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:34.604678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:34.605282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:34.611515 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:34.611985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:34.612742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:34.613170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:34.672827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:34.680537 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1529df53-2ced-4144-b8b7-7b0792873c47 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079553 Nov 09 05:29:34.681103 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1051/2011] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:34 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:35.697068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:35.697724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:35.703975 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:35.704420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:35.705195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:35.705633 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:35.766745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:35.774922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-56d7d30a-16b6-43c9-8bf3-e5b25c5867ff tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081630 Nov 09 05:29:35.775483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 961/2012] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:35 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:36.791387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:36.792020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:36.797896 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:36.798347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:36.799110 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:36.799542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:36.857168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:36.865442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-771875bb-5a1d-4532-a7f0-5e5370ca9a80 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077833 Nov 09 05:29:36.866003 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1052/2013] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:36 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:37.882610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:37.883199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:37.889532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:37.889975 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:37.890746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:37.891180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:37.949169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:37.956860 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-53a22b19-a238-49f1-8895-ad52aa780d85 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077980 Nov 09 05:29:37.957419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 962/2014] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:37 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:38.974222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:38.974859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:38.981136 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:38.981594 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:38.982349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:38.982778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:39.040468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:39.048016 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b2accf66-403d-4b5c-8160-808089d69c0e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077966 Nov 09 05:29:39.048584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1053/2015] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:38 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:40.065117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:40.065709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:40.072207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:40.072659 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:40.073436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:40.073876 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:40.132199 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:40.139872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-27ff05d2-96c6-4e8f-ac74-a8f14289b31d tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078445 Nov 09 05:29:40.140435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 963/2016] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:40 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:41.156188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:41.156795 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:41.163654 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:41.164105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:41.164862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:41.165290 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:41.225695 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:41.233367 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e111fdf7-4c05-4feb-88c4-9e3b869d946c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080813 Nov 09 05:29:41.233924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1054/2017] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:41 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:42.249893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:42.250499 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:42.257631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:42.258085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:42.258861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:42.259302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:42.317666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:42.325391 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-78c918ae-2be9-4d35-b2e5-a30d8b2a4227 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079200 Nov 09 05:29:42.325957 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 964/2018] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:42 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:43.341990 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:43.342591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:43.349445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:43.349893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:43.350653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:43.351079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:43.408774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:43.416941 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0fd669d0-cdfe-4a35-9cdf-961bd0188f60 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078623 Nov 09 05:29:43.417503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1055/2019] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:43 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:44.433508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:44.434150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:44.440872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:44.441324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:44.442627 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:44.443064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:44.503086 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:44.511720 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2a5428c3-5d35-4533-9bdd-cf4855ba9df6 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081846 Nov 09 05:29:44.512244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 965/2020] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:44 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:45.528689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:45.529281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:45.535442 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:45.535911 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:45.536661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:45.537085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:45.594899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:45.602551 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-583fbb74-00fe-4af7-9dd6-02b377c3386b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077530 Nov 09 05:29:45.603126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1056/2021] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:45 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:46.618883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:46.619490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:46.625796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:46.626512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:46.627293 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:46.627756 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:46.685368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:46.693593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-491c7432-c336-4045-9641-722799cd7500 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078357 Nov 09 05:29:46.694159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 966/2022] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:46 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:47.711776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:47.712378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:47.718550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:47.718988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:47.719774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:47.720202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:47.778144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:47.786462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f983df71-3a21-49f6-8060-cce005279d25 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078205 Nov 09 05:29:47.787015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1057/2023] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:47 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:48.803853 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:48.804461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:48.810686 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:48.811130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:48.811936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:48.812364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:48.872792 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:48.880897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-12f785c7-d01f-4e64-bdee-90e3c502dc93 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.081467 Nov 09 05:29:48.881727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 967/2024] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:48 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:49.897481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:49.898141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:49.904402 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:49.904850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:49.905611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:49.906042 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:49.964638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:49.972324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-199a3c61-126d-4341-a738-5abf8644d927 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078571 Nov 09 05:29:49.972924 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1058/2025] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:49 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:50.987916 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:50.988564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:50.994897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:50.995349 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:50.996185 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:50.996643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:51.055712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:51.063339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a4a4add-d05c-4e9f-beea-edba9c564140 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.079074 Nov 09 05:29:51.063929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 968/2026] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:50 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:51.681151 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:29:51.681612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:29:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:29:52.080263 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:52.080869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:52.087168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:52.087612 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:52.088404 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:52.088834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:52.147732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:52.155245 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-032b4fbb-26ce-4cf9-a470-0be93cff289e tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078601 Nov 09 05:29:52.155827 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1059/2027] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:52 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:53.171719 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:53.172250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:53.179087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:53.179513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:53.180302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:53.180731 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:53.237908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:53.246394 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0a503f98-2997-491e-a613-579035d64b36 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078376 Nov 09 05:29:53.246964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 969/2028] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:53 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:54.263242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:54.263855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:54.270626 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:54.271060 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:54.271845 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:54.272266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:54.332778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:54.340293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-74908e2c-9ea5-434f-871f-0445d8407613 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.080633 Nov 09 05:29:54.340825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1060/2029] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:54 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:54.425423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:29:54.426369 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:29:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:29:55.356794 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:55.357322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:55.363552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:55.364027 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:55.364798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:55.365231 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:55.423715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:55.431421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-efbf3703-e0fe-4f31-8b5b-a559c293981b tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078370 Nov 09 05:29:55.432015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 970/2030] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:55 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:56.448248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:56.448818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:56.454962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:56.455398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:56.456178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:56.456602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:56.514401 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:56.522468 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-156971f8-0bf1-403b-abfe-0b48f944d6c3 tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.077857 Nov 09 05:29:56.523026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1061/2031] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:56 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:29:57.539134 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:29:57.539759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] [instance: 367541e4-c608-43b0-90da-677a42dc9b16] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:29:57.545571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:57.546014 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:57.546777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:29:57.547207 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:29:57.605867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd77e7d6b09ac482f8bf1bcf4c83ed05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03305e25979a4de2b9bf721e0ac9fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:29:57.614174 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c6cb7d7-50e6-416c-b5fb-fe38e9b2c08c tempest-ServerRescueNegativeTestJSON-1953747205 tempest-ServerRescueNegativeTestJSON-1953747205-project] 10.222.0.41 "GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16" status: 200 len: 1352 microversion: 2.1 time: 0.078986 Nov 09 05:29:57.614744 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 971/2032] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:29:57 2021] GET /compute/v2.1/servers/367541e4-c608-43b0-90da-677a42dc9b16 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:30:02.306394 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2bfd32ee-20c9-4bf3-af6b-f60289d1363c tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Action: 'create', calling method: .version_select at 0x7f30d1181dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1257970291", "metadata": {"Type": "work"}}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:30:02.307807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2bfd32ee-20c9-4bf3-af6b-f60289d1363c tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:30:02.308618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2bfd32ee-20c9-4bf3-af6b-f60289d1363c tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.219478 Nov 09 05:30:02.309183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1062/2033] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 9 05:30:02 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 05:30:02.318379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4b238c1a-504f-4166-8634-106c85be9652 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Action: 'create', calling method: .version_select at 0x7f30cc0d95e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-506963240", "metadata": {"Type": "work"}}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:30:02.319932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4b238c1a-504f-4166-8634-106c85be9652 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:30:02.320722 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4b238c1a-504f-4166-8634-106c85be9652 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006157 Nov 09 05:30:02.321230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 972/2034] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 9 05:30:02 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 09 05:30:02.329450 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4ac29dfd-2fca-4bfd-96e4-67c7c41773e2 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Action: 'create', calling method: .version_select at 0x7f30cc753160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2067182024", "metadata": {"Type": "work"}}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:30:02.330678 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4ac29dfd-2fca-4bfd-96e4-67c7c41773e2 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:30:02.331533 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4ac29dfd-2fca-4bfd-96e4-67c7c41773e2 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005663 Nov 09 05:30:02.332117 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1063/2035] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 9 05:30:02 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 05:30:02.340684 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-38efd36b-6481-4164-a148-0b5113ba4f57 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Calling method '.version_select at 0x7f30bfdabdc0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:30:21.921889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:30:21.922617 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:30:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-2073308538 (ip 10.222.0.41) !!! Nov 09 05:30:24.217281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:30:24.217855 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:30:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:30:57.671385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-38efd36b-6481-4164-a148-0b5113ba4f57 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] HTTP exception thrown: Volume tempest-invalid-2073308538 could not be found. Nov 09 05:30:57.672025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-38efd36b-6481-4164-a148-0b5113ba4f57 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Returning 404 to user: Volume tempest-invalid-2073308538 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:30:57.672861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-38efd36b-6481-4164-a148-0b5113ba4f57 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2073308538" status: 404 len: 99 microversion: 2.1 time: 55.336141 Nov 09 05:30:57.673410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 973/2036] 10.222.0.41 () {58 vars in 1217 bytes} [Tue Nov 9 05:30:02 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2073308538 => generated 99 bytes in 55337 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 09 05:30:57.683556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-97068f9b-37e5-4641-b6ad-fab3118e0016 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004366 Nov 09 05:30:57.684372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1064/2037] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Nov 9 05:30:57 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 09 05:30:57.693138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-95ffce51-d9bc-482c-9508-9006290b306c tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004279 Nov 09 05:30:57.694178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 974/2038] 10.222.0.41 () {58 vars in 1136 bytes} [Tue Nov 9 05:30:57 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 09 05:30:57.703158 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-14722a18-b6bd-4a17-aec3-669f9e6f4358 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Calling method '.version_select at 0x7f30d1181ee0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:30:57.858583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-14722a18-b6bd-4a17-aec3-669f9e6f4358 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] HTTP exception thrown: Volume 4bb1005e-45b1-408e-900d-f983fed4838b could not be found. Nov 09 05:30:57.859185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-14722a18-b6bd-4a17-aec3-669f9e6f4358 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Returning 404 to user: Volume 4bb1005e-45b1-408e-900d-f983fed4838b could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:30:57.860077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-14722a18-b6bd-4a17-aec3-669f9e6f4358 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/4bb1005e-45b1-408e-900d-f983fed4838b" status: 404 len: 109 microversion: 2.1 time: 0.161292 Nov 09 05:30:57.860764 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1065/2039] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 9 05:30:57 2021] DELETE /compute/v2.1/os-volumes/4bb1005e-45b1-408e-900d-f983fed4838b => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 05:30:57.870163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d1bed47f-cd51-4906-84b6-363d1ade5188 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Calling method '.version_select at 0x7f30bfdb60d0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:30:58.190454 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-d1bed47f-cd51-4906-84b6-363d1ade5188 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] HTTP exception thrown: Volume 94aec02c-4c15-4153-a236-d506f5c82cfc could not be found. Nov 09 05:30:58.191050 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d1bed47f-cd51-4906-84b6-363d1ade5188 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] Returning 404 to user: Volume 94aec02c-4c15-4153-a236-d506f5c82cfc could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:30:58.192070 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d1bed47f-cd51-4906-84b6-363d1ade5188 tempest-VolumesNegativeTest-1596357385 tempest-VolumesNegativeTest-1596357385-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/94aec02c-4c15-4153-a236-d506f5c82cfc" status: 404 len: 109 microversion: 2.1 time: 0.325475 Nov 09 05:30:58.192508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 975/2040] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 05:30:57 2021] GET /compute/v2.1/os-volumes/94aec02c-4c15-4153-a236-d506f5c82cfc => generated 109 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:31:09.251980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ad57c302-49f8-4998-a898-9a09e8a8a128 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30d11c19d0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:09.300882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ad57c302-49f8-4998-a898-9a09e8a8a128 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bfb61ed2-4246-4913-9b63-dab0c9a80b99" status: 200 len: 350 microversion: 2.1 time: 0.053181 Nov 09 05:31:09.301565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1066/2041] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 05:31:09 2021] GET /compute/v2.1/os-volumes/bfb61ed2-4246-4913-9b63-dab0c9a80b99 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:17.005776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ee626a30-ec57-4ec7-be56-0e31d56b1cc4 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30cc038a60>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:17.053342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ee626a30-ec57-4ec7-be56-0e31d56b1cc4 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/821fcaa1-ddca-4198-8039-81f7c6d77334" status: 200 len: 351 microversion: 2.1 time: 0.051638 Nov 09 05:31:17.054079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 976/2042] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 05:31:17 2021] GET /compute/v2.1/os-volumes/821fcaa1-ddca-4198-8039-81f7c6d77334 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:18.420893 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a20a817b-7651-49e3-a6c0-d9ae7575b5a1 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30d11914c0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:18.468212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a20a817b-7651-49e3-a6c0-d9ae7575b5a1 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/2a134ce1-735c-46c8-8808-3462fb809786" status: 200 len: 349 microversion: 2.1 time: 0.051264 Nov 09 05:31:18.469190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1067/2043] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 9 05:31:18 2021] GET /compute/v2.1/os-volumes/2a134ce1-735c-46c8-8808-3462fb809786 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:18.482036 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-65f91604-90ae-4ff8-bb8e-4f7c53327c3b tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30bfdaddc0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:18.565873 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-65f91604-90ae-4ff8-bb8e-4f7c53327c3b tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089230 Nov 09 05:31:18.566442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 977/2044] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 9 05:31:18 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:18.578124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f961504a-d9d3-49ae-8a3b-24b1b5b06d98 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30cc877670>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:18.658630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f961504a-d9d3-49ae-8a3b-24b1b5b06d98 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083956 Nov 09 05:31:18.659200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1068/2045] 10.222.0.41 () {58 vars in 1148 bytes} [Tue Nov 9 05:31:18 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:18.671529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a7beaf7e-0520-431d-b8be-f6f12543b482 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30d11d5430>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:18.751419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a7beaf7e-0520-431d-b8be-f6f12543b482 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083477 Nov 09 05:31:18.752122 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 978/2046] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 9 05:31:18 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:31:18.762805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cfd81741-2aec-474e-8f6d-e01408e910f6 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30d11608b0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:18.843337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cfd81741-2aec-474e-8f6d-e01408e910f6 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083967 Nov 09 05:31:18.848978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1069/2047] 10.222.0.41 () {58 vars in 1166 bytes} [Tue Nov 9 05:31:18 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:18.855568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ea6630c1-c805-4fd0-a3d8-ff0c4614e558 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30bfe04af0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:19.095754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ea6630c1-c805-4fd0-a3d8-ff0c4614e558 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.244157 Nov 09 05:31:19.096599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 979/2048] 10.222.0.41 () {58 vars in 1169 bytes} [Tue Nov 9 05:31:18 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:19.109915 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-393bbd3d-5935-4838-ac52-eb625bb929f6 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30cc8bf1f0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:19.198510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-393bbd3d-5935-4838-ac52-eb625bb929f6 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.092906 Nov 09 05:31:19.199083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1070/2049] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Nov 9 05:31:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:31:19.210119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-42cb05d4-e91b-4ba4-873e-a2aac2d524a3 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30bfe040d0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:19.289385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-42cb05d4-e91b-4ba4-873e-a2aac2d524a3 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082965 Nov 09 05:31:19.291194 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 980/2050] 10.222.0.41 () {58 vars in 1187 bytes} [Tue Nov 9 05:31:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:31:19.301640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cffdb5bd-7589-4ac6-b04e-0c1c26168df7 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] Calling method '.version_select at 0x7f30d1178790>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:19.385444 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cffdb5bd-7589-4ac6-b04e-0c1c26168df7 tempest-VolumesTestJSON-921352223 tempest-VolumesTestJSON-921352223-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087637 Nov 09 05:31:19.386007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1071/2051] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Nov 9 05:31:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:31.698949 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:31:31.699688 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:31:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:31:38.468998 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:31:38.469559 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:31:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:31:43.995778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8cf1df04-47a5-4ebf-9f65-c560aec8b50b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Action: 'create', calling method: .version_select at 0x7f30d11d5940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1445089433"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:31:44.013028 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-8cf1df04-47a5-4ebf-9f65-c560aec8b50b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Getting quotas for project 00555c9dc6b94b048368752dc235deba. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:31:44.017101 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-8cf1df04-47a5-4ebf-9f65-c560aec8b50b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Getting quotas for user 52a9719a05fc4cc79e9096ae8746c382 and project 00555c9dc6b94b048368752dc235deba. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:31:44.362458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-8cf1df04-47a5-4ebf-9f65-c560aec8b50b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Getting quotas for project 00555c9dc6b94b048368752dc235deba. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:31:44.366039 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-8cf1df04-47a5-4ebf-9f65-c560aec8b50b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Getting quotas for user 52a9719a05fc4cc79e9096ae8746c382 and project 00555c9dc6b94b048368752dc235deba. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:31:44.379776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8cf1df04-47a5-4ebf-9f65-c560aec8b50b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.388325 Nov 09 05:31:44.380391 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 981/2052] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 9 05:31:43 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:44.430353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1028615865", "imageRef": "f81c3d65-eecb-4342-871f-f525160ff7c6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1445089433", "networks": [{"uuid": "07d5c80c-0680-416c-abc7-d57cb6e89b86"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:31:44.480432 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] validate_networks() for [('07d5c80c-0680-416c-abc7-d57cb6e89b86', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:31:44.962052 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:31:44.962628 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:31:44.963089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:31:44.963836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:31:44.964242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:31:44.973015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:44.973646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:44.974600 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:44.975169 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:44.995095 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Getting quotas for project 00555c9dc6b94b048368752dc235deba. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:31:44.999390 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Getting quotas for user 52a9719a05fc4cc79e9096ae8746c382 and project 00555c9dc6b94b048368752dc235deba. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:31:45.010266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:31:45.012529 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f81c3d65-eecb-4342-871f-f525160ff7c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:31:45.063499 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d3184260-a897-401b-b5b2-49175c642339 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638209 Nov 09 05:31:45.064260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1072/2053] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 05:31:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 05:31:45.074898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f75e5007-dba2-4076-89e4-3d0e63405877 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:45.076305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f75e5007-dba2-4076-89e4-3d0e63405877 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:45.141889 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f75e5007-dba2-4076-89e4-3d0e63405877 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:45.149670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f75e5007-dba2-4076-89e4-3d0e63405877 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1259 microversion: 2.1 time: 0.079372 Nov 09 05:31:45.151899 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 982/2054] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:45 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:46.169126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:46.169723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:46.175766 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:46.176208 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:46.176969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:46.177389 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:46.238443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:46.245474 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5cf3e8ac-aef4-479d-a265-4dc6cd796b32 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1263 microversion: 2.1 time: 0.081988 Nov 09 05:31:46.246021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1073/2055] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:46 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:47.262735 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:47.263494 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:47.274591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:47.275344 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:47.276602 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:47.277283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:47.339917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:47.347136 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f2ad9202-41e6-4168-8b6a-726b4252e8fe tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1263 microversion: 2.1 time: 0.089430 Nov 09 05:31:47.347706 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 983/2056] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:47 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:48.362698 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:48.363298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:48.369852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:48.370293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:48.371051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:48.371473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:48.429293 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:48.436681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-86089724-e028-4774-97b0-b0071434b63d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1263 microversion: 2.1 time: 0.077537 Nov 09 05:31:48.437334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1074/2057] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:48 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:49.456000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:49.456610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:49.462763 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:49.463214 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:49.464025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:49.464462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:49.521693 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:49.528783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6f9868ad-51ac-4461-8c44-cb4d4c3b88df tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1255 microversion: 2.1 time: 0.076558 Nov 09 05:31:49.529334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 984/2058] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:49 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1255 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:50.545605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:50.546210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:50.552504 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:50.552956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:50.553756 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:50.554187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:50.613610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:50.620750 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cd674003-695e-492a-b5fb-ed9f91aaf60c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1255 microversion: 2.1 time: 0.078784 Nov 09 05:31:50.621308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1075/2059] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:50 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1255 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:51.638389 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:51.639221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:51.647275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:51.648539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:51.651320 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:51.652515 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:51.797066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:51.815676 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-550ef441-2f62-4fe1-bcdc-c865adeed756 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1317 microversion: 2.1 time: 0.181472 Nov 09 05:31:51.818385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 985/2060] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:51 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:52.835769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:52.836549 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:52.843246 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:52.843719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:52.844538 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:52.844994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:52.987907 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:52.995861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1a7d1543-6562-456e-983d-bff90e01a404 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.164087 Nov 09 05:31:52.996646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1076/2061] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:52 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:54.018252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:54.018867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:54.025399 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:54.025849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:54.027310 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:54.027790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:54.180440 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:54.187952 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4c6e85dc-26a8-42b1-980a-f4ccd1840656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.177716 Nov 09 05:31:54.188541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 986/2062] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:54 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:31:55.205968 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:55.207739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:55.215254 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:55.215794 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:55.217172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:55.217611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:55.366332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:55.375412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1a8be27c-6364-4222-a99d-5f0e0a344ac2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.173602 Nov 09 05:31:55.385754 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1077/2063] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:55 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:56.393055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:56.393882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:56.402120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:56.402936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:56.404299 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:56.404748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:56.551637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:56.559663 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-324f8814-8786-45cc-8fb6-eec38e1d4a33 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.170570 Nov 09 05:31:56.560295 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 987/2064] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:56 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:57.576545 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:57.577276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:57.584308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:57.585001 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:57.586007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:57.586614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:57.728808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:57.736191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-24258553-683e-4362-a3ce-d2674bdc6b04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.163276 Nov 09 05:31:57.736782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1078/2065] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:57 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:58.754035 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:58.754520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:58.763977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:58.763977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:58.763977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:58.763977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:58.910271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:31:58.918584 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5666d391-24c0-4643-8b37-05a63d2c53f1 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.168487 Nov 09 05:31:58.919376 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 988/2066] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:58 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:31:59.935277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:31:59.936021 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:31:59.947322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:59.947899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:31:59.948916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:31:59.949348 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:00.424140 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:00.438728 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9e4fca35-7e8b-4442-b17c-85f5abd2e954 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.506063 Nov 09 05:32:00.439986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1079/2067] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:31:59 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:01.458305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:01.459189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:01.468006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:01.468828 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:01.469736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:01.470272 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:01.718398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:01.726193 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fc428d4b-d836-4cbc-978e-6f4044a2df24 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.273858 Nov 09 05:32:01.727287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 989/2068] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:01 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:02.744209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:02.744810 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:02.751274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:02.751745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:02.752511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:02.752938 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:02.891918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:02.901094 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-94c37607-8351-4ed3-a9c9-a2dfeaf899bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.161143 Nov 09 05:32:02.901676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1080/2069] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:02 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:03.917348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:03.917947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:03.923835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:03.924283 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:03.925055 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:03.925484 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:04.065600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:04.073538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-29bc4cbf-561d-4cd5-9a80-0630b93b0f7b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.159795 Nov 09 05:32:04.074099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 990/2070] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:03 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:05.090752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:05.091344 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:05.097449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:05.097890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:05.099028 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:05.099457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:05.226276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:05.233472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7c6f3af7-5b55-4382-ae0b-83ea9654d3fa tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.146540 Nov 09 05:32:05.234027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1081/2071] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:05 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:06.250140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:06.250746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:06.257095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:06.257491 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:06.258262 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:06.258696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:06.386364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:06.393459 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-9c364290-d5df-4d68-bea4-37feef203bc3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.147218 Nov 09 05:32:06.394021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 991/2072] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:06 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:07.409981 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:07.410590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:07.417644 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:07.418091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:07.418850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:07.419279 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:07.546851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:07.554037 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a662263d-4373-4f9c-9e41-1e6b8d6edced tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.147690 Nov 09 05:32:07.555299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1082/2073] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:07 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:08.572180 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:08.572796 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:08.579116 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:08.579568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:08.580379 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:08.580818 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:08.704897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:08.712119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5c846f42-9969-4a7b-871d-3bd45eb25050 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.144488 Nov 09 05:32:08.712685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 992/2074] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:08 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:09.728848 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:09.729445 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:09.735772 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:09.736212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:09.736958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:09.737381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:09.872417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:09.879797 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bd8dc373-d16a-4e3b-a8bc-e788936a413e tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.154611 Nov 09 05:32:09.880355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1083/2075] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:09 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:10.896956 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:10.897568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:10.904431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:10.904884 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:10.905655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:10.906087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:11.032433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:11.039490 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6507cce9-020c-4ea6-80df-15f94a49c916 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.146252 Nov 09 05:32:11.040089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 993/2076] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:10 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:12.055479 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:12.056105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:12.062330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:12.062767 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:12.063516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:12.063971 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:12.191310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:12.199012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7fe5daba-fc8d-4bd3-b793-478fae5bbf4b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.147192 Nov 09 05:32:12.199583 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1084/2077] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:12 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:13.216010 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:13.216541 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:13.222736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:13.223183 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:13.223981 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:13.224415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:13.353217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:13.360513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5353de98-c9ed-452d-9301-7c61dd71f609 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.148292 Nov 09 05:32:13.361064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 994/2078] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:13 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:32:14.376986 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:14.377494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:14.383812 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:14.384257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:14.385015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:14.385441 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:14.514833 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:14.522212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e502ed01-2c41-4d57-bae9-4825ad1ee988 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.149054 Nov 09 05:32:14.522777 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1085/2079] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:14 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:15.539850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:15.540656 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:15.546880 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:15.547322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:15.551142 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:15.551589 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:15.682346 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:15.690051 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a20ff613-0c7a-4907-9741-e8d29224499a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.154418 Nov 09 05:32:15.690613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 995/2080] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:15 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:16.706625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:16.707319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:16.716995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:16.717453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:16.718276 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:16.718700 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:16.755610 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-6ce4b59b-5c0b-4598-a7c8-805ca909ef82 req-2177388e-ed6c-44df-973c-2165ccb2db65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:16.757994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:32:16.757994 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:32:16.769334 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-6ce4b59b-5c0b-4598-a7c8-805ca909ef82 req-2177388e-ed6c-44df-973c-2165ccb2db65 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:16.769920 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-6ce4b59b-5c0b-4598-a7c8-805ca909ef82 req-2177388e-ed6c-44df-973c-2165ccb2db65 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:16.784239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-6ce4b59b-5c0b-4598-a7c8-805ca909ef82 req-2177388e-ed6c-44df-973c-2165ccb2db65 service nova] Creating event network-changed:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:32:16.799839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-6ce4b59b-5c0b-4598-a7c8-805ca909ef82 req-2177388e-ed6c-44df-973c-2165ccb2db65 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238989 Nov 09 05:32:16.801503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1086/2081] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:32:16.922084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:16.929289 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fdedfce9-6b9d-4b5e-9fcc-c610f5d39d82 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.226475 Nov 09 05:32:16.929893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 996/2082] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:16 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:32:17.946550 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:17.947231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:17.953222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:17.953667 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:17.954421 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:17.954883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:18.087571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:18.094902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-2eb678a0-fb92-40c0-b717-2d30dbc6e8c8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.152791 Nov 09 05:32:18.095467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1087/2083] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:17 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:19.112365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:19.112961 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:19.120045 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:19.120483 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:19.121244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:19.121668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:19.257049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:19.265123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-737d8923-9325-4c7a-85b3-eabffad0b8e8 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.156303 Nov 09 05:32:19.265702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 997/2084] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:19 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:20.282040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:20.282665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:20.288900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:20.289335 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:20.290111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:20.290536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:20.421574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:20.429040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-010d06fe-e031-4348-a199-31c32e5d5dbf tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.150594 Nov 09 05:32:20.429691 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1088/2085] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:20 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:21.447099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:21.448238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:21.454652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:21.455134 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:21.456049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:21.456500 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:21.587222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:21.594565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ed8a3099-0099-43f6-a8e7-4bb234038656 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.151658 Nov 09 05:32:21.595120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 998/2086] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:21 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:22.611238 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:22.611867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:22.619984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:22.620417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:22.621185 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:22.621618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:22.758210 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:22.765388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d920f2ea-3ff6-47fd-8b47-a5ae15119d80 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.158535 Nov 09 05:32:22.765957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1089/2087] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:22 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:23.782850 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:23.783360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:23.790464 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:23.790908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:23.791698 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:23.792132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:23.917635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:23.924851 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e97d84fc-39ea-4715-bc36-34fdfa9c3221 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.145799 Nov 09 05:32:23.925421 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 999/2088] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:23 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:32:24.941910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:24.942511 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:24.948761 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:24.949200 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:24.949956 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:24.950380 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:25.078867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:25.086020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-76c75b8d-7ec7-4e42-b332-779e30a3fd4a tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.147751 Nov 09 05:32:25.087110 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1090/2089] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:24 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:26.103599 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:26.104219 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:26.110806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:26.111248 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:26.112048 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:26.112476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:26.236989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:26.244696 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5503900f-3d78-46ef-83f0-141d3c98b567 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.145275 Nov 09 05:32:26.245252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1000/2090] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:26 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:27.261690 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:27.262426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:27.269381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:27.270187 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:27.271790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:27.272535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:27.404324 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:27.411429 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9a2d0e39-82f3-40cc-b8c5-f71771893e92 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.154013 Nov 09 05:32:27.412030 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1091/2091] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:27 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:28.428856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:28.429468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:28.436893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:28.437414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:28.438368 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:28.438864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:28.572641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:28.579754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4a3b5392-8fa7-47bb-a9f3-50374a529da5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.154689 Nov 09 05:32:28.580326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1001/2092] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:28 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:29.245781 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-9c4bb8d4-cfb8-47ce-ab0d-9d92ab615af0 req-30f56ab0-b0e3-4291-a0b9-6d165cf55909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "name": "network-vif-plugged", "status": "completed", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:29.247277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:32:29.247277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:32:29.254178 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-9c4bb8d4-cfb8-47ce-ab0d-9d92ab615af0 req-30f56ab0-b0e3-4291-a0b9-6d165cf55909 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:29.254916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-9c4bb8d4-cfb8-47ce-ab0d-9d92ab615af0 req-30f56ab0-b0e3-4291-a0b9-6d165cf55909 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:29.266272 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-9c4bb8d4-cfb8-47ce-ab0d-9d92ab615af0 req-30f56ab0-b0e3-4291-a0b9-6d165cf55909 service nova] Creating event network-vif-plugged:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:32:29.271194 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-9c4bb8d4-cfb8-47ce-ab0d-9d92ab615af0 req-30f56ab0-b0e3-4291-a0b9-6d165cf55909 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168078 Nov 09 05:32:29.271873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1092/2093] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:32:29.596573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:29.597791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:29.604469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:29.605064 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:29.605920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:29.606279 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:29.738190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:29.746327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-01355a94-da3a-4b04-91bd-1b3f00a0217b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.153298 Nov 09 05:32:29.747026 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1002/2094] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:29 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:30.765010 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:30.765837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:30.772263 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:30.772901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:30.774578 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:30.775046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:30.932900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:30.940393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-64e4a6e4-e44f-4344-a330-e5b51d4018bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1359 microversion: 2.1 time: 0.179847 Nov 09 05:32:30.940958 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1093/2095] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:30 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:31.957435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:31.958053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:31.964971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:31.965416 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:31.966190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:31.966625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.100600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:32.108405 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7a1e7adc-31d5-471f-8b7b-ccf710d2f861 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1549 microversion: 2.1 time: 0.154441 Nov 09 05:32:32.109252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1003/2096] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:31 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:32.125660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:32.126464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:32.132418 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:32.133716 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.134497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:32.134931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.271650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:32.281191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-bb38c207-4d1c-4381-86f1-4e155c16a820 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1549 microversion: 2.1 time: 0.159421 Nov 09 05:32:32.281751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1094/2097] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:32 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:32.299092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:32.303118 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:32:32.303118 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:32:32.304337 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:32.305650 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Searching by: {'deleted': False, 'project_id': '00555c9dc6b94b048368752dc235deba'} {{(pid=115445) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 09 05:32:32.312634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:32.313157 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.313974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:32.314410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.405607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.multi_cell_list [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115445) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 09 05:32:32.506224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-70113d17-800a-4aec-8f5c-1e30e260045d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210922 Nov 09 05:32:32.506798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1004/2098] 10.222.0.41 () {58 vars in 1124 bytes} [Tue Nov 9 05:32:32 2021] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:32:32.517937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:32.521157 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:32.524616 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:32.525108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.525953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:32.526387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:32.663274 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:32.673890 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-411819a8-865f-400a-ae2f-2c1595e8aba9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1549 microversion: 2.1 time: 0.159614 Nov 09 05:32:32.674525 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1095/2099] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:32 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:34.202402 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bdeaca2-5616-498c-bfcf-c388cfd14b30"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:34.203455 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:34.210435 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:34.211100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:34.212062 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:34.212801 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:34.499770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e7d83216-6b6f-4cd5-9e0f-74fc7ca4ef2b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300857 Nov 09 05:32:34.500628 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1005/2100] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 9 05:32:34 2021] POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:32:43.320586 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:43.321816 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:43.329133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:43.329577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:43.330837 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:43.331280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:43.860112 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:43.875488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cc6f41c2-1a29-43c9-8746-21e2d76a2548 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1595 microversion: 2.1 time: 0.563654 Nov 09 05:32:43.876119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1096/2101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:43 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1595 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:44.393833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-671277d0-766b-4e8b-b385-4755dd79fe73 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Action: 'create', calling method: .version_select at 0x7f30bfdab550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1158366711"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:44.407803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-671277d0-766b-4e8b-b385-4755dd79fe73 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Getting quotas for project 4dc498cab6aa40d2b4929df08abc9e02. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:32:44.412343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-671277d0-766b-4e8b-b385-4755dd79fe73 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Getting quotas for user d2457318b0094619b0fd1499f2c5732d and project 4dc498cab6aa40d2b4929df08abc9e02. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:32:44.777222 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-671277d0-766b-4e8b-b385-4755dd79fe73 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Getting quotas for project 4dc498cab6aa40d2b4929df08abc9e02. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:32:44.781328 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-671277d0-766b-4e8b-b385-4755dd79fe73 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Getting quotas for user d2457318b0094619b0fd1499f2c5732d and project 4dc498cab6aa40d2b4929df08abc9e02. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:32:44.796096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-671277d0-766b-4e8b-b385-4755dd79fe73 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.606047 Nov 09 05:32:44.796715 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1006/2102] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 9 05:32:44 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:32:46.067109 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-c618eb15-3011-4265-a298-bb79fd933a98 req-978d6a92-8e05-450c-ba19-c9ab6b03104b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:46.069219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:32:46.069219 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:32:46.077470 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-c618eb15-3011-4265-a298-bb79fd933a98 req-978d6a92-8e05-450c-ba19-c9ab6b03104b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:46.078084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-c618eb15-3011-4265-a298-bb79fd933a98 req-978d6a92-8e05-450c-ba19-c9ab6b03104b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:46.091065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-c618eb15-3011-4265-a298-bb79fd933a98 req-978d6a92-8e05-450c-ba19-c9ab6b03104b service nova] Creating event network-changed:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:32:46.097204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-c618eb15-3011-4265-a298-bb79fd933a98 req-978d6a92-8e05-450c-ba19-c9ab6b03104b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121292 Nov 09 05:32:46.098384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1097/2103] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:32:47.234060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-637825353"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:47.235652 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:47.244223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:47.245107 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:47.246643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:47.247606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:47.398753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.network.security_group_api [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Adding security group f230c3ee-5f2f-4796-a652-4c8691cbd0d1 to port 0b0e8e30-d2bf-430d-82d0-e3d903854ee8 Nov 09 05:32:47.791929 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-61ec7a7e-37fc-437b-9930-416eaf6b64a3 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/action" status: 202 len: 0 microversion: 2.1 time: 0.561604 Nov 09 05:32:47.793418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1007/2104] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:32:47 2021] POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:32:47.801132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-074efe25-8553-466f-aad3-9db15c2bac48 req-ac268e8d-b6ee-4195-a4e0-9461b976f6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:32:47.802288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:32:47.802288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:32:47.807150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:32:47.808007 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:32:47.821127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:47.821868 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:47.822856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:47.823888 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:47.826416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-074efe25-8553-466f-aad3-9db15c2bac48 req-ac268e8d-b6ee-4195-a4e0-9461b976f6b7 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:32:47.831055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-074efe25-8553-466f-aad3-9db15c2bac48 req-ac268e8d-b6ee-4195-a4e0-9461b976f6b7 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:32:47.852306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-074efe25-8553-466f-aad3-9db15c2bac48 req-ac268e8d-b6ee-4195-a4e0-9461b976f6b7 service nova] Creating event network-changed:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:32:47.861122 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-074efe25-8553-466f-aad3-9db15c2bac48 req-ac268e8d-b6ee-4195-a4e0-9461b976f6b7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064556 Nov 09 05:32:47.872640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1098/2105] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:32:48.114059 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:32:48.123795 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-38f41d55-58e5-4c68-ae6f-0e9140fb198b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1760 microversion: 2.1 time: 0.320061 Nov 09 05:32:48.124385 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1008/2106] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:32:47 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1760 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:11.699428 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:33:11.699899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:33:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:33:14.443094 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:33:14.443606 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:33:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:33:29.525903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1095035454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1158366711", "security_groups": [{"name": "tempest-secgroup-smoke-49634301"}], "networks": [{"uuid": "d5dffa1a-0347-4770-a8cf-284d426927ae"}], "block_device_mapping_v2": [{"uuid": "4b2b405b-dbdf-430b-8e6e-6dcdaf2f19b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:33:29.636606 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] validate_networks() for [('d5dffa1a-0347-4770-a8cf-284d426927ae', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:33:29.992403 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:33:29.992760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:33:29.993255 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:33:29.993677 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:33:29.994077 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:33:30.002686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:30.003118 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:30.003937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:30.004362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:30.020347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Getting quotas for project 4dc498cab6aa40d2b4929df08abc9e02. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:33:30.024722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Getting quotas for user d2457318b0094619b0fd1499f2c5732d and project 4dc498cab6aa40d2b4929df08abc9e02. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:33:30.078600 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:33:30.080842 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b2b405b-dbdf-430b-8e6e-6dcdaf2f19b1',volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:33:30.207598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5104f30e-827e-40bb-92a7-38d19979afff tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.681074 Nov 09 05:33:30.207598 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1099/2107] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 05:33:29 2021] POST /compute/v2.1/servers => generated 404 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 05:33:30.213251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-41785833-7653-42c6-bd24-5953ef40f1dd tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:30.213872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-41785833-7653-42c6-bd24-5953ef40f1dd tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:30.264843 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-41785833-7653-42c6-bd24-5953ef40f1dd tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:30.271725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-41785833-7653-42c6-bd24-5953ef40f1dd tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1089 microversion: 2.1 time: 0.062836 Nov 09 05:33:30.273343 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1009/2108] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:30 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1089 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:31.289388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:31.289999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:31.296646 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:31.297098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:31.297885 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:31.298593 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:31.367862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:31.376611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-5ca2aaa7-d46c-44a3-b8bb-ee1eb93f37d3 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1205 microversion: 2.1 time: 0.091606 Nov 09 05:33:31.377307 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1100/2109] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:31 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:33:32.394052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:32.395205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:32.404401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:32.405044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:32.406013 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:32.406604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:32.635707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:32.643427 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c0f86964-d858-4af9-8ca9-998f405fd239 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.253662 Nov 09 05:33:32.644176 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1010/2110] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:32 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:32.718524 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-f50d1c12-7710-4130-a91a-abcc3111c760 req-fa1a747e-f562-406c-839a-9cf8c2e6c4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:33:32.720115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:33:32.720115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:33:32.727869 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-f50d1c12-7710-4130-a91a-abcc3111c760 req-fa1a747e-f562-406c-839a-9cf8c2e6c4bf service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:32.728310 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-f50d1c12-7710-4130-a91a-abcc3111c760 req-fa1a747e-f562-406c-839a-9cf8c2e6c4bf service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:32.741408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-f50d1c12-7710-4130-a91a-abcc3111c760 req-fa1a747e-f562-406c-839a-9cf8c2e6c4bf service nova] Creating event network-changed:d0981ecd-ad8a-42b8-840f-33ac9b44003f for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 on hv-cinder-81713 Nov 09 05:33:32.749218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-f50d1c12-7710-4130-a91a-abcc3111c760 req-fa1a747e-f562-406c-839a-9cf8c2e6c4bf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034899 Nov 09 05:33:32.753729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1101/2111] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:33:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:33:33.660363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:33.661001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:33.667826 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:33.668215 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:33.668991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:33.669434 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:33.822460 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:33.829645 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-102570c3-d2c1-4d31-b56d-0a2920bd3529 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.173027 Nov 09 05:33:33.830212 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1011/2112] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:33 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:34.847079 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:34.847692 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:34.853760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:34.854204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:34.854965 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:34.855393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:34.987097 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:34.995081 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c94c70c5-d222-4a79-a9eb-10b6f5fcf953 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.152564 Nov 09 05:33:34.995661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1102/2113] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:34 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:36.012263 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:36.012863 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:36.019729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:36.020177 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:36.021038 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:36.021502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:36.153963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:36.161159 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e9d34404-fc3c-4914-8080-80b8e4fc61c6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.152557 Nov 09 05:33:36.161718 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1012/2114] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:36 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:37.178292 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:37.178937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:37.185488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:37.185937 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:37.186710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:37.187144 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:37.314589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:37.322302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-dec2f14d-04f1-4e92-a21f-4af55bbfb9a7 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.148567 Nov 09 05:33:37.322863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1103/2115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:37 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:38.338414 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:38.339006 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:38.345153 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:38.345591 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:38.346348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:38.346774 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:38.473015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:38.480140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5873e637-2812-40fd-86b5-867ba5f8485d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.145383 Nov 09 05:33:38.480702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1013/2116] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:38 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:39.497280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:39.498026 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:39.504563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:39.505013 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:39.505773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:39.506726 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:39.636065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:39.643130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-493b7f73-c715-47f9-8733-1798c05b7222 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.149831 Nov 09 05:33:39.643723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1104/2117] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:39 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:40.659930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:40.660533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:40.667229 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:40.667691 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:40.668477 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:40.668906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:40.798496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:40.805748 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a2adf382-c20e-43e6-a5a4-a8ff25998c36 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.149414 Nov 09 05:33:40.806309 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1014/2118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:40 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:41.822085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:41.822615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:41.828902 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:41.829342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:41.830108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:41.830540 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:41.966829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:41.974043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-274f30bb-3575-4ae4-bd66-9a7864fcaa8a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.155666 Nov 09 05:33:41.975124 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1105/2119] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:41 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:33:42.991090 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:42.992342 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:42.998841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:42.999290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:43.000096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:43.000530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:43.127781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:43.135883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4226ba81-9a9b-4f60-b8e8-03f58cd4ebf6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.148461 Nov 09 05:33:43.136463 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1015/2120] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:42 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:44.151536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:44.152164 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:44.158635 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:44.159071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:44.159851 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:44.160276 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:44.287609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:44.295473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-059844f2-1b47-43db-b0b3-b89163019843 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.147581 Nov 09 05:33:44.296066 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1106/2121] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:44 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:45.311838 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:45.312364 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:45.318538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:45.318986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:45.320341 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:45.320781 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:45.446021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:45.453258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-19559982-5695-49cf-9d52-b64522c155ca tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.145217 Nov 09 05:33:45.453832 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1016/2122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:45 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:45.886669 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-2547ad53-740a-42e2-8e97-ac1ffad8e0e9 req-40c45eef-9365-4816-898d-378ef3e83f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "name": "network-vif-plugged", "status": "completed", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:33:45.888555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:33:45.888555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:33:45.895571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-2547ad53-740a-42e2-8e97-ac1ffad8e0e9 req-40c45eef-9365-4816-898d-378ef3e83f39 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:45.896035 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-2547ad53-740a-42e2-8e97-ac1ffad8e0e9 req-40c45eef-9365-4816-898d-378ef3e83f39 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:45.907043 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-2547ad53-740a-42e2-8e97-ac1ffad8e0e9 req-40c45eef-9365-4816-898d-378ef3e83f39 service nova] Creating event network-vif-plugged:d0981ecd-ad8a-42b8-840f-33ac9b44003f for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 on hv-cinder-81713 Nov 09 05:33:45.911852 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-2547ad53-740a-42e2-8e97-ac1ffad8e0e9 req-40c45eef-9365-4816-898d-378ef3e83f39 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028670 Nov 09 05:33:45.912417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1107/2123] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:33:46.470221 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:46.470848 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:46.477742 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:46.478241 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:46.479015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:46.479513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:46.610806 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:46.618085 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-209dd246-c67e-447f-89f0-922b64776ec0 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.151679 Nov 09 05:33:46.618643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1017/2124] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:46 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:47.636064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:47.637350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:47.643873 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:47.644320 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:47.645104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:47.645534 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:47.787308 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:47.795163 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-43464b8e-4680-4860-8611-2f71d205edab tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1259 microversion: 2.1 time: 0.163604 Nov 09 05:33:47.795747 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1108/2125] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:47 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:48.812037 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:48.812655 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:48.818932 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:48.819365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:48.820196 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:48.820632 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:49.223812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:49.231586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4db06a93-8590-435f-9da6-90399cbd3939 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1443 microversion: 2.1 time: 0.423406 Nov 09 05:33:49.232163 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1018/2126] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:48 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1443 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:49.247643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:33:49.248242 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:33:49.254425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:49.254858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:49.255609 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:49.256058 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:49.385671 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:33:49.393088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-89a8c41a-4aec-4b76-80dd-d77fba19d2b9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1443 microversion: 2.1 time: 0.149328 Nov 09 05:33:49.393653 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1109/2127] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:33:49 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:33:51.402473 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-333a12c5-e2f1-49c9-89ad-fa58192880e2 req-15805560-95c8-4607-8599-a1e75ada6d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:33:51.404054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:33:51.404054 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:33:51.410993 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-333a12c5-e2f1-49c9-89ad-fa58192880e2 req-15805560-95c8-4607-8599-a1e75ada6d93 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:33:51.411423 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-333a12c5-e2f1-49c9-89ad-fa58192880e2 req-15805560-95c8-4607-8599-a1e75ada6d93 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:33:51.422190 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-333a12c5-e2f1-49c9-89ad-fa58192880e2 req-15805560-95c8-4607-8599-a1e75ada6d93 service nova] Creating event network-changed:d0981ecd-ad8a-42b8-840f-33ac9b44003f for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 on hv-cinder-81713 Nov 09 05:33:51.427537 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-333a12c5-e2f1-49c9-89ad-fa58192880e2 req-15805560-95c8-4607-8599-a1e75ada6d93 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028538 Nov 09 05:33:51.428179 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1019/2128] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:33:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:34:32.629951 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:34:32.630883 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:32.636880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:32.637314 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:32.638093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:32.638516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:32.706382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ea899930-e719-4a22-ba0c-b63fc985240c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/action" status: 202 len: 0 microversion: 2.1 time: 0.079883 Nov 09 05:34:32.707004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1110/2129] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:34:32 2021] POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:34:32.716785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:32.717571 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:32.724258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:32.724757 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:32.725554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:32.725987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:33.146662 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:33.155224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6ed583ee-3f65-4abb-ad88-e074f8d9ad3d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1752 microversion: 2.1 time: 0.443665 Nov 09 05:34:33.155839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1020/2130] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:32 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1752 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:34.173651 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:34.174260 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:34.180332 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:34.180783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:34.181548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:34.181983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:34.377352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:34.385126 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f69f0314-f172-43c4-aec3-9b54ff9fb8a5 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.216100 Nov 09 05:34:34.385691 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1111/2131] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:34 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:35.402365 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:35.402963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:35.409135 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:35.409577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:35.410331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:35.410754 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:35.552361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:35.560072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a6633148-d413-4c5c-9a5f-16a93f8ace79 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.161326 Nov 09 05:34:35.560631 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1021/2132] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:35 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:36.579014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:36.579686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:36.585536 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:36.585978 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:36.586736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:36.587166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:36.728369 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:36.736074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-61487086-35c9-4d3c-b1cc-26d17782bdd7 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.160834 Nov 09 05:34:36.736636 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1112/2133] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:36 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:34:37.754314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:37.754915 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:37.761690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:37.762138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:37.762904 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:37.763335 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:37.906468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:37.914256 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-8b89f9ec-fb36-40c4-82e9-f9cc95ddd134 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.163903 Nov 09 05:34:37.914831 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1022/2134] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:37 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:38.930731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:38.931996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:38.938287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:38.938734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:38.939503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:38.939973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:39.077570 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:39.085269 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6b18980d-a8b5-4e54-a765-2854355ae7c0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.158261 Nov 09 05:34:39.085868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1113/2135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:38 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:40.101987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:40.102590 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:40.108942 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:40.109386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:40.110145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:40.110574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:40.253298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:40.261563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ec2d10d8-61f2-4a2b-ae0c-16ff4d623c28 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.163251 Nov 09 05:34:40.262130 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1023/2136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:40 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:41.280814 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:41.281482 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:41.287910 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:41.288365 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:41.289132 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:41.289568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:41.429859 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:41.438100 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-adeb1aed-1421-453c-afa5-dff4a91852a0 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.161181 Nov 09 05:34:41.438663 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1114/2137] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:41 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:42.455069 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:42.455725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:42.462334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:42.462779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:42.463544 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:42.463994 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:42.603034 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:42.610839 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-13483993-fe99-463f-b4ce-c80a9f14a8cd tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.159482 Nov 09 05:34:42.611400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1024/2138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:42 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:43.628250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:43.628850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:43.635090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:43.635532 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:43.636323 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:43.636751 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:43.775226 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:43.782903 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4766b27a-5820-4cb4-bc9d-0616a12e7379 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.158317 Nov 09 05:34:43.783467 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1115/2139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:43 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:44.800886 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:44.801485 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:44.808002 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:44.808444 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:44.809210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:44.809643 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:44.961108 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:44.969322 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b4212fa3-60d4-4d5f-8ef1-f8dfe4162280 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.172082 Nov 09 05:34:44.969890 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1025/2140] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:44 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:45.986141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:45.986932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:45.993233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:45.993686 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:45.995299 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:45.995748 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:46.140857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:46.148406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-95a61cc8-0f62-4a30-b3ec-a5fc0449ade2 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.166048 Nov 09 05:34:46.148966 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1116/2141] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:45 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:47.165363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:47.165970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:47.172210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:47.172661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:47.173445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:47.173882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:47.312192 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:47.320347 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-cc72c444-557f-4cea-b7f3-4bed983037a9 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.158652 Nov 09 05:34:47.320919 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1026/2142] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:47 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:48.337790 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:48.338406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:48.344660 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:48.345104 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:48.345870 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:48.346306 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:48.483589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:48.491280 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-448bb029-c9d3-4cb2-bc68-db7fe9f9a65b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1757 microversion: 2.1 time: 0.157166 Nov 09 05:34:48.491879 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1117/2143] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:48 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:34:49.508992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:34:49.510100 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:34:49.516286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:49.516733 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:49.517498 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:34:49.517928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:34:49.660287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:34:49.667963 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0edad6ff-f64e-4917-ba87-861f7e4ce83f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1760 microversion: 2.1 time: 0.162578 Nov 09 05:34:49.668529 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1027/2144] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:34:49 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:35:52.992119 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-637825353"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:35:52.992736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:53.000618 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:53.001395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:53.002205 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:53.002641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:53.136051 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.network.security_group_api [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Removing security group f230c3ee-5f2f-4796-a652-4c8691cbd0d1 from port 0b0e8e30-d2bf-430d-82d0-e3d903854ee8 Nov 09 05:35:53.458974 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cd7ae189-691d-473f-ac75-b607ba9d9a08 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/action" status: 202 len: 0 microversion: 2.1 time: 0.471442 Nov 09 05:35:53.460240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1118/2145] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:35:52 2021] POST /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:35:53.469867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-73d49867-5cc8-44a5-8398-039679dd65e8 req-ba380072-f3f8-4b54-b099-6e6e921d3f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:35:53.472378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:35:53.472378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:35:53.480531 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-73d49867-5cc8-44a5-8398-039679dd65e8 req-ba380072-f3f8-4b54-b099-6e6e921d3f8f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:53.481240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-73d49867-5cc8-44a5-8398-039679dd65e8 req-ba380072-f3f8-4b54-b099-6e6e921d3f8f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:53.494091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-73d49867-5cc8-44a5-8398-039679dd65e8 req-ba380072-f3f8-4b54-b099-6e6e921d3f8f service nova] Creating event network-changed:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:35:53.500161 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-73d49867-5cc8-44a5-8398-039679dd65e8 req-ba380072-f3f8-4b54-b099-6e6e921d3f8f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036078 Nov 09 05:35:53.501468 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1028/2146] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:35:54.622454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:54.622969 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:54.629541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:54.629985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:54.630770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:54.631213 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:54.708853 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lazy-loading 'services' on Instance uuid 5ed7e219-44f9-44d4-a944-af7bb467820a {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:35:54.819291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e78e47f5-88e5-4271-b87b-305825488e55 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments/9bdeaca2-5616-498c-bfcf-c388cfd14b30" status: 202 len: 0 microversion: 2.1 time: 0.200880 Nov 09 05:35:54.819948 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1119/2147] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 05:35:54 2021] DELETE /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments/9bdeaca2-5616-498c-bfcf-c388cfd14b30 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:35:54.830736 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:54.831533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:54.837615 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:54.838060 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:54.838847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:54.839285 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:54.867834 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b7563da4-bdc1-4e1d-b44d-1b7dccd1824c tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042581 Nov 09 05:35:54.868909 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1029/2148] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:35:54 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:35:55.515877 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-c83a1b28-4916-4b04-99cc-e4ae08db409a req-64cfd03e-4830-4faf-b781-e8a7cd554a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:35:55.517438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:35:55.517438 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:35:55.525282 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-c83a1b28-4916-4b04-99cc-e4ae08db409a req-64cfd03e-4830-4faf-b781-e8a7cd554a5a service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:55.525722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-c83a1b28-4916-4b04-99cc-e4ae08db409a req-64cfd03e-4830-4faf-b781-e8a7cd554a5a service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:55.536744 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-c83a1b28-4916-4b04-99cc-e4ae08db409a req-64cfd03e-4830-4faf-b781-e8a7cd554a5a service nova] Creating event network-changed:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:35:55.542133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-c83a1b28-4916-4b04-99cc-e4ae08db409a req-64cfd03e-4830-4faf-b781-e8a7cd554a5a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030377 Nov 09 05:35:55.542733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1120/2149] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:35:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:35:55.880822 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:55.881713 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:55.888734 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:55.889120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:55.889908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:55.890528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:55.921729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e44f9cae-9e5d-4ce2-8ad7-7e7d1669f08d tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045476 Nov 09 05:35:55.922317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1030/2150] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 9 05:35:55 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 05:35:55.934286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:55.934863 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:55.941120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:55.941565 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:55.942338 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:55.942763 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:56.020452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] HTTP exception thrown: Instance 5ed7e219-44f9-44d4-a944-af7bb467820a is not attached to volume 9bdeaca2-5616-498c-bfcf-c388cfd14b30 Nov 09 05:35:56.021074 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Returning 404 to user: Instance 5ed7e219-44f9-44d4-a944-af7bb467820a is not attached to volume 9bdeaca2-5616-498c-bfcf-c388cfd14b30 {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:35:56.021931 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-216567ad-9bda-4894-9b78-970599a5af04 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments/9bdeaca2-5616-498c-bfcf-c388cfd14b30" status: 404 len: 154 microversion: 2.1 time: 0.092525 Nov 09 05:35:56.022489 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1121/2151] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 9 05:35:55 2021] DELETE /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a/os-volume_attachments/9bdeaca2-5616-498c-bfcf-c388cfd14b30 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 05:35:57.157930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:57.158418 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:57.164355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:57.164803 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:57.166254 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:57.166716 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:57.189528 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:35:57.258138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-d0f34e47-1e54-4a25-9ca0-d6b71dd0003b tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 204 len: 0 microversion: 2.1 time: 0.103717 Nov 09 05:35:57.258807 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1031/2152] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:35:57 2021] DELETE /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:35:57.267209 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:57.267844 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:57.274019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:57.274464 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:57.275838 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:57.276266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:57.557147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:35:57.564443 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d0033cd0-7d0c-4521-814c-4f9e1a93b953 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1555 microversion: 2.1 time: 0.300911 Nov 09 05:35:57.565228 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1122/2153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:35:57 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1555 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:35:58.582189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:58.582877 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:58.589128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:58.589566 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:58.590327 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:58.590752 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:58.722137 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:35:58.729947 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-837195cf-d107-48b1-96fb-f59b4588a277 tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1555 microversion: 2.1 time: 0.151778 Nov 09 05:35:58.730506 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1032/2154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:35:58 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:35:59.747371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:35:59.747957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:35:59.754257 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:59.754699 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:59.755497 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:59.755953 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:59.815929 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a9719a05fc4cc79e9096ae8746c382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00555c9dc6b94b048368752dc235deba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:35:59.823472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-779c38f6-ecc5-46fa-99ca-f64416117f8f tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 200 len: 1513 microversion: 2.1 time: 0.080588 Nov 09 05:35:59.824362 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1123/2155] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:35:59 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 1513 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:35:59.877564 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-54003ba1-fe1d-4bcd-896b-bc558b3b437a req-8d99e59e-1e3d-4844-812e-4bf81fbf2c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed7e219-44f9-44d4-a944-af7bb467820a", "name": "network-vif-deleted", "tag": "0b0e8e30-d2bf-430d-82d0-e3d903854ee8"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:35:59.879361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:35:59.879361 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:35:59.888041 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-54003ba1-fe1d-4bcd-896b-bc558b3b437a req-8d99e59e-1e3d-4844-812e-4bf81fbf2c0b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:35:59.888533 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-54003ba1-fe1d-4bcd-896b-bc558b3b437a req-8d99e59e-1e3d-4844-812e-4bf81fbf2c0b service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:35:59.901469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-54003ba1-fe1d-4bcd-896b-bc558b3b437a req-8d99e59e-1e3d-4844-812e-4bf81fbf2c0b service nova] Creating event network-vif-deleted:0b0e8e30-d2bf-430d-82d0-e3d903854ee8 for instance 5ed7e219-44f9-44d4-a944-af7bb467820a on hv-cinder-81713 Nov 09 05:35:59.907812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-54003ba1-fe1d-4bcd-896b-bc558b3b437a req-8d99e59e-1e3d-4844-812e-4bf81fbf2c0b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Nov 09 05:35:59.908771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1033/2156] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:35:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:36:00.840966 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:00.841466 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] [instance: 5ed7e219-44f9-44d4-a944-af7bb467820a] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:00.847732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:00.848182 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:00.848942 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:00.849370 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:00.862477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] HTTP exception thrown: Instance 5ed7e219-44f9-44d4-a944-af7bb467820a could not be found. Nov 09 05:36:00.863049 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Returning 404 to user: Instance 5ed7e219-44f9-44d4-a944-af7bb467820a could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:36:00.863882 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-55e86062-2919-4ea7-9048-d934350933bc tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a" status: 404 len: 111 microversion: 2.1 time: 0.027153 Nov 09 05:36:00.864399 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1124/2157] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:00 2021] GET /compute/v2.1/servers/5ed7e219-44f9-44d4-a944-af7bb467820a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:36:00.873133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-541d508b-f497-4eaf-8fa4-312ac18cd3ce tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] Calling method '.version_select at 0x7f30d109bca0>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:00.890286 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-541d508b-f497-4eaf-8fa4-312ac18cd3ce tempest-TestMinimumBasicScenario-1737704007 tempest-TestMinimumBasicScenario-1737704007-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1445089433" status: 202 len: 0 microversion: 2.1 time: 0.021091 Nov 09 05:36:00.890879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1034/2158] 10.222.0.41 () {58 vars in 1271 bytes} [Tue Nov 9 05:36:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1445089433 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:36:08.998729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:08.999267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:09.005029 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:09.005477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:09.006240 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:09.006672 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:09.029753 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lazy-loading 'flavor' on Instance uuid 440b9e5e-8a48-42a8-835e-f94fb65adf94 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:36:09.103381 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c02f9764-ac7d-435a-ad24-31a436bbb638 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "POST /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94/action" status: 202 len: 0 microversion: 2.1 time: 0.107417 Nov 09 05:36:09.104183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1125/2159] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:36:08 2021] POST /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:36:09.112635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:09.113972 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:09.120760 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:09.121378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:09.122319 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:09.123092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:09.281056 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:09.288944 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-34d2af3c-772a-4970-9c69-6e12f35949fa tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.180404 Nov 09 05:36:09.290000 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1035/2160] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:09 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:10.306975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:10.308338 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:10.317141 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:10.317791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:10.318742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:10.319311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:10.534835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:10.542835 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8b8ab995-a930-43ec-acc9-ce6165d32920 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.240045 Nov 09 05:36:10.543415 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1126/2161] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:10 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:11.559925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:11.561132 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:11.567569 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:11.568296 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:11.569273 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:11.569997 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:11.716118 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:11.725235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c774e300-1d61-4bcf-b05c-396eae9ea145 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.169550 Nov 09 05:36:11.726573 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1036/2162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:11 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:12.744697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:12.745366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:12.751836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:12.752291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:12.753076 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:12.753507 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:13.013125 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:13.021440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8ca28e62-5b06-4a10-a0fc-c929f7109c80 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.281026 Nov 09 05:36:13.032427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1127/2163] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:12 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:14.039216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:14.040450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:14.051164 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:14.051883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:14.053128 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:14.053568 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:14.209087 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:14.216918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-0e60dc61-8679-4f97-acd6-12fea4e7bc3b tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.181916 Nov 09 05:36:14.217649 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1037/2164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:14 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:36:15.242739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:15.244737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:15.251222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:15.251773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:15.252792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:15.253406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:15.656846 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:15.664581 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f016bc7a-58cf-4c10-93d6-faf0d70e911a tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.430384 Nov 09 05:36:15.665261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1128/2165] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:15 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:16.681675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:16.683220 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:16.689936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:16.690624 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:16.691412 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:16.691859 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:16.964462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:16.973480 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f0600b4d-ed03-45fb-bf90-edd2f07f3339 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.295349 Nov 09 05:36:16.974067 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1038/2166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:16 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:36:17.990388 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:17.992027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:17.999318 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:18.000183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:18.001107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:18.001818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:18.149503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:18.159087 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-0a3ce413-d74b-4f0d-828d-c2ccf82fdade tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.172296 Nov 09 05:36:18.161249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1129/2167] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:17 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:18.877169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-a26a6378-98a9-4136-b56a-93e4f12136bd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Action: 'create', calling method: .version_select at 0x7f30d11f4d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2044191353"}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:18.891854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a26a6378-98a9-4136-b56a-93e4f12136bd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:36:18.895583 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a26a6378-98a9-4136-b56a-93e4f12136bd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for user 0e16463bf33240d8835e67a27448cdc9 and project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:36:19.176731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:19.177982 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:19.189233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:19.190724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:19.192162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:19.194190 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:19.326805 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a26a6378-98a9-4136-b56a-93e4f12136bd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:36:19.330743 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-a26a6378-98a9-4136-b56a-93e4f12136bd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for user 0e16463bf33240d8835e67a27448cdc9 and project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'key_pairs'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:36:19.351732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:19.355838 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-a26a6378-98a9-4136-b56a-93e4f12136bd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.649973 Nov 09 05:36:19.356445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1039/2168] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 9 05:36:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:19.372614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b348ebf3-7eea-49a8-bad1-7aa0b0d70127 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.199561 Nov 09 05:36:19.373098 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1130/2169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:19 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:36:20.389897 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:20.390621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:20.397106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:20.397626 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:20.398476 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:20.398948 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:20.547239 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:20.555442 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6d01ac12-8d04-4f73-9a3c-fb375e42dcf9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.169657 Nov 09 05:36:20.556169 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1040/2170] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:20 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:36:21.573115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:21.573724 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:21.580110 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:21.580547 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:21.581305 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:21.581734 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:21.731531 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:21.745817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e7b62f1e-eebb-49c2-8a05-eb4c99c6e3ed tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.176715 Nov 09 05:36:21.757277 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1131/2171] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:21 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:22.763727 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:22.764530 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:22.770855 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:22.771572 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:22.774044 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:22.774724 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:23.076906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:23.084175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c6d4179d-5b6c-42fa-8fbb-0bb06ff42354 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1509 microversion: 2.1 time: 0.324118 Nov 09 05:36:23.084739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1041/2172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:22 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:23.100162 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:23.100723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:23.107347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:23.107823 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:23.108577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:23.108996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:23.206535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [5ffcfe0f-5744-4334-b509-b73f7a5372dc] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 05:36:24.223395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [5ffcfe0f-5744-4334-b509-b73f7a5372dc] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50320. Nov 09 05:36:24.228584 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f09313d1-ccfa-401d-ad0b-da86552a3023 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "POST /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94/action" status: 202 len: 0 microversion: 2.1 time: 1.131864 Nov 09 05:36:24.230012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1132/2173] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 9 05:36:23 2021] POST /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:36:24.239911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:24.241808 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:24.250593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:24.250887 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:24.251737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:24.252170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:24.384303 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:24.392016 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4b469c27-4080-4791-b8cd-11a1809d6770 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1517 microversion: 2.1 time: 0.157892 Nov 09 05:36:24.392570 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1042/2174] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:24 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:24.602412 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-8163be26-b290-47f8-8082-45c63d705f37 req-5f77d064-9125-48f8-8636-a9de951ac18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "name": "network-vif-unplugged", "status": "completed", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:24.604917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:36:24.604917 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:36:24.613311 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-8163be26-b290-47f8-8082-45c63d705f37 req-5f77d064-9125-48f8-8636-a9de951ac18f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:24.613928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-8163be26-b290-47f8-8082-45c63d705f37 req-5f77d064-9125-48f8-8636-a9de951ac18f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:24.626327 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.compute.server_external_events [req-8163be26-b290-47f8-8082-45c63d705f37 req-5f77d064-9125-48f8-8636-a9de951ac18f service nova] Unable to find a host for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94. Dropping event network-vif-unplugged {{(pid=115446) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 09 05:36:24.627322 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-8163be26-b290-47f8-8082-45c63d705f37 req-5f77d064-9125-48f8-8636-a9de951ac18f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029596 Nov 09 05:36:24.628398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1133/2175] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:36:24 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 09 05:36:25.410168 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:25.411098 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:25.418856 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:25.419607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:25.420674 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:25.421250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:25.561640 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:25.569970 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f08aff9c-5be0-4d4c-8f7e-d1583ae12faf tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1519 microversion: 2.1 time: 0.163376 Nov 09 05:36:25.576783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1043/2176] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:25 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:26.587385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:26.588591 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:26.596221 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:26.596674 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:26.597447 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:26.597887 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:26.738111 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:26.745944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ab140949-30ef-4a94-9eb0-126ded522f6d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.162936 Nov 09 05:36:26.746498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1134/2177] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:26 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:27.762917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:27.763420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:27.769318 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:27.769769 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:27.770539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:27.770971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:27.907084 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:27.914964 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-086701d8-ffcc-4b10-84bb-d62249229f86 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.155400 Nov 09 05:36:27.915518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1044/2178] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:27 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:28.932331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:28.932928 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:28.939130 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:28.939569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:28.940355 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:28.940782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:29.077462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:29.084689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-696e5876-3304-4dbc-b2fd-4609ea5a95cc tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.156718 Nov 09 05:36:29.085253 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1135/2179] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:28 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:30.101479 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:30.102702 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:30.108908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:30.109362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:30.110170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:30.110614 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:30.242117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:30.250061 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2fb95e9b-efcf-468f-b691-f4a170f09d94 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.152325 Nov 09 05:36:30.250625 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1045/2180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:30 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:31.267452 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:31.268059 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:31.274286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:31.274722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:31.275477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:31.275933 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:31.411352 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:31.419204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-e4367fdd-09f9-4e52-ab79-e0d9ad0d39ea tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.155415 Nov 09 05:36:31.419806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1136/2181] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:31 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:36:31.723017 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:36:31.723224 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:36:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:36:32.435021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:32.435651 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:32.441865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:32.442311 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:32.443081 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:32.443513 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:32.580738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:32.588730 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e92ff4e4-9c6e-4bec-8dca-779bec9592ae tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.157137 Nov 09 05:36:32.589226 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1046/2182] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:32 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:33.606670 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:33.607331 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:33.613985 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:33.614425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:33.615176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:33.615599 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:33.750454 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:33.758425 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f008770e-576d-4a34-8f8d-d446c15680a1 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.156199 Nov 09 05:36:33.758973 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1137/2183] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:33 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:34.461859 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:36:34.462301 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:36:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:36:34.775505 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:34.776166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:34.782488 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:34.782937 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:34.783764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:34.784197 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:34.916924 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:34.924552 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-5487e1a6-8de1-409c-8000-d89659a2ce09 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.153313 Nov 09 05:36:34.925109 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1047/2184] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:34 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:35.941576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:35.942172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:35.948758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:35.949212 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:35.949984 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:35.950419 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:36.078762 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:36.086146 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-28614f7a-e120-4d52-aefe-80e06585f888 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.148393 Nov 09 05:36:36.086922 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1138/2185] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:35 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:36.735271 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-1f1d12a0-3c46-4815-bf41-9d589ba77496 req-1edd1067-e855-4033-ae81-a902f3e7565a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "name": "network-vif-plugged", "status": "completed", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:36.736810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:36:36.736810 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:36:36.746697 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-1f1d12a0-3c46-4815-bf41-9d589ba77496 req-1edd1067-e855-4033-ae81-a902f3e7565a service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:36.747340 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-1f1d12a0-3c46-4815-bf41-9d589ba77496 req-1edd1067-e855-4033-ae81-a902f3e7565a service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:36.759082 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-1f1d12a0-3c46-4815-bf41-9d589ba77496 req-1edd1067-e855-4033-ae81-a902f3e7565a service nova] Creating event network-vif-plugged:d0981ecd-ad8a-42b8-840f-33ac9b44003f for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 on hv-cinder-81713 Nov 09 05:36:36.764660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-1f1d12a0-3c46-4815-bf41-9d589ba77496 req-1edd1067-e855-4033-ae81-a902f3e7565a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Nov 09 05:36:36.765612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1048/2186] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:36:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:36:37.103360 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:37.104007 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:37.110408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:37.110858 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:37.111643 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:37.112091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:37.240871 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:37.248727 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-96fb239f-41a4-4b21-a7f3-fbf444abdbc6 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.149541 Nov 09 05:36:37.249286 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1139/2187] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:37 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:38.266170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:38.266864 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:38.273384 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:38.273833 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:38.274600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:38.275033 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:38.405073 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:38.412287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-99ac4a08-d03e-4a53-8bc6-bc3ec2846632 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1575 microversion: 2.1 time: 0.150160 Nov 09 05:36:38.412847 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1049/2188] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:38 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:39.428991 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:39.429614 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:39.435857 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:39.436301 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:39.437054 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:39.437484 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:39.581024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:39.588900 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ddc3a3cc-909a-4759-a399-9d813e00d855 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1562 microversion: 2.1 time: 0.163562 Nov 09 05:36:39.589457 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1140/2189] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:39 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:42.908988 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-468373024", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2044191353", "security_groups": [{"name": "tempest-secgroup-smoke-718520608"}], "block_device_mapping_v2": [{"uuid": "1f142f2b-6270-4c2d-94de-9b1caa6ac523", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d681ff-6cd4-4ae6-b07c-bd0311e9f7c5"}]}} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:43.015127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.network.neutron [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] validate_networks() for [('11d681ff-6cd4-4ae6-b07c-bd0311e9f7c5', None, None, None, None, None)] {{(pid=115445) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:36:43.416811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Flavor limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:36:43.417233 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Image limits 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:36:43.417709 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Flavor pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:36:43.418119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Image pref 0:0:0 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:36:43.418535 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.virt.hardware [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:36:43.426986 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:43.427436 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:43.428292 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:43.428732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:43.444509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:36:43.448380 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.quota [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for user 0e16463bf33240d8835e67a27448cdc9 and project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'instances', 'cores', 'ram'} {{(pid=115445) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:36:43.502885 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Going to run 1 instances... {{(pid=115445) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:36:43.505052 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f142f2b-6270-4c2d-94de-9b1caa6ac523',volume_size=None,volume_type=None)] {{(pid=115445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:36:43.624098 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f66f599f-1816-4238-a9a5-ecfd535c82cd tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718639 Nov 09 05:36:43.624732 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1050/2190] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 05:36:42 2021] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 05:36:43.634366 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c3d8d6c0-57b4-4fb6-8442-dbb3674d63e5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:43.634972 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c3d8d6c0-57b4-4fb6-8442-dbb3674d63e5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:43.686217 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-c3d8d6c0-57b4-4fb6-8442-dbb3674d63e5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:43.692729 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c3d8d6c0-57b4-4fb6-8442-dbb3674d63e5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1094 microversion: 2.1 time: 0.061978 Nov 09 05:36:43.693351 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1141/2191] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:43 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:44.709595 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:44.710217 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:44.716938 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:44.717481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:44.718348 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:44.718865 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:44.792945 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:44.799598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b1fe9361-93ea-469c-9fe0-06c973a1fd9c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1200 microversion: 2.1 time: 0.093669 Nov 09 05:36:44.800244 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1051/2192] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:44 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:45.817291 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:45.817897 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:45.825940 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:45.826639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:45.827665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:45.828261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:45.968528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:45.978171 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9338d272-6685-408b-869b-0bf236815a81 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.164498 Nov 09 05:36:45.978752 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1142/2193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:45 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:46.055882 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-697ac026-a61e-44a1-a0f7-0046a8695d80 req-cd8d58f1-ba82-4df6-b280-3dfc3c8a0c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513f5cdb-61fc-49c2-bab7-66f56a53a045", "tag": "5cb0f394-d81f-41ee-a6e3-d97c6277f973"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:46.058326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:36:46.058326 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:36:46.066927 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-697ac026-a61e-44a1-a0f7-0046a8695d80 req-cd8d58f1-ba82-4df6-b280-3dfc3c8a0c94 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:46.067587 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-697ac026-a61e-44a1-a0f7-0046a8695d80 req-cd8d58f1-ba82-4df6-b280-3dfc3c8a0c94 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:46.082785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-697ac026-a61e-44a1-a0f7-0046a8695d80 req-cd8d58f1-ba82-4df6-b280-3dfc3c8a0c94 service nova] Creating event network-changed:5cb0f394-d81f-41ee-a6e3-d97c6277f973 for instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 on hv-cinder-81713 Nov 09 05:36:46.088049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-697ac026-a61e-44a1-a0f7-0046a8695d80 req-cd8d58f1-ba82-4df6-b280-3dfc3c8a0c94 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036626 Nov 09 05:36:46.089306 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1052/2194] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:36:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:36:46.996046 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:46.996638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:47.003107 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:47.003542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:47.004341 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:47.004760 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:47.144022 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:47.151321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-106290d3-17c7-443b-861e-174d9de0f862 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.159505 Nov 09 05:36:47.151993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1143/2195] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:46 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:48.168992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:48.169714 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:48.175778 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:48.176227 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:48.176995 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:48.177429 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:48.303780 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:48.310978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-533a5a57-bebb-4c06-ac6d-2855d5d16ce3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.147058 Nov 09 05:36:48.311538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1053/2196] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:48 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:49.327522 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:49.328183 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:49.334449 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:49.334891 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:49.335681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:49.336630 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:49.467605 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:49.474834 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-a4e6e5b2-10c2-4aca-adfa-6acb3b74f03c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.151016 Nov 09 05:36:49.475393 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1144/2197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:49 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:50.492672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:50.493338 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:50.499502 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:50.499977 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:50.500751 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:50.501210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:50.633974 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:50.641127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c1e4d647-b41d-4c0e-9c38-92299546e3de tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.152480 Nov 09 05:36:50.641685 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1054/2198] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:50 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:51.657976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:51.658575 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:51.664862 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:51.665321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:51.666085 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:51.666494 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:51.797817 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:51.805544 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-abe687b0-9879-43f6-8cc5-2123ae47dc91 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.150652 Nov 09 05:36:51.806214 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1145/2199] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:51 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:52.821891 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:52.822419 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:52.828789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:52.829245 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:52.830021 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:52.830458 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:52.957920 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:52.965110 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-118693f8-abc4-4413-b771-f120e47e754a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.147015 Nov 09 05:36:52.965670 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1055/2200] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:52 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:53.982268 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:53.982868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:53.989266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:53.989711 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:53.990472 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:53.990901 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:54.117769 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:54.124916 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9cbe5bd0-b1f0-4ee1-9348-d24649846e0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.146282 Nov 09 05:36:54.125477 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1146/2201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:53 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:55.141518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:55.142127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:55.149112 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:55.149560 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:55.150332 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:55.150770 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:55.283188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:55.290581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-f314bf61-bde3-480c-9782-4d4b3dd14ba9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.152711 Nov 09 05:36:55.291140 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1056/2202] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:55 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:56.307813 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:56.308406 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:56.314866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:56.315309 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:56.316080 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:56.316503 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:56.442569 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:56.450330 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-818a1ebb-63cb-487d-877a-18738d14e673 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.146812 Nov 09 05:36:56.450880 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1147/2203] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:56 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:56.854230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-4f6cc3fa-5989-49a3-a840-a561d9ff9b3d req-b72fbf49-0928-4d56-8090-f0e9712eaa73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513f5cdb-61fc-49c2-bab7-66f56a53a045", "name": "network-vif-plugged", "status": "completed", "tag": "5cb0f394-d81f-41ee-a6e3-d97c6277f973"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:36:56.855879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:36:56.855879 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:36:56.863250 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-4f6cc3fa-5989-49a3-a840-a561d9ff9b3d req-b72fbf49-0928-4d56-8090-f0e9712eaa73 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:56.863729 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-4f6cc3fa-5989-49a3-a840-a561d9ff9b3d req-b72fbf49-0928-4d56-8090-f0e9712eaa73 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:56.877746 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-4f6cc3fa-5989-49a3-a840-a561d9ff9b3d req-b72fbf49-0928-4d56-8090-f0e9712eaa73 service nova] Creating event network-vif-plugged:5cb0f394-d81f-41ee-a6e3-d97c6277f973 for instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 on hv-cinder-81713 Nov 09 05:36:56.882812 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-4f6cc3fa-5989-49a3-a840-a561d9ff9b3d req-b72fbf49-0928-4d56-8090-f0e9712eaa73 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032813 Nov 09 05:36:56.883401 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1057/2204] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:36:57.467913 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:57.468492 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:57.474987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:57.475422 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:57.476211 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:57.476652 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:57.629828 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:57.637426 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9dd302c9-5c7b-4dde-9141-047212012cea tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1265 microversion: 2.1 time: 0.173561 Nov 09 05:36:57.637996 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1148/2205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:57 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:58.655049 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:58.655764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:58.661913 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:58.662371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:58.663143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:58.663581 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:58.796740 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:58.804156 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-938013f5-9e6d-4943-8adb-a8fb8beed785 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1453 microversion: 2.1 time: 0.153653 Nov 09 05:36:58.805323 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1058/2206] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:58 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:36:58.821147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:36:58.821687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:36:58.827899 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:58.828347 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:58.829108 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:36:58.829542 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:36:58.956192 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:36:58.963516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1c37bc71-dd4a-45c0-99bb-5771a32d61ff tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1453 microversion: 2.1 time: 0.146025 Nov 09 05:36:58.964105 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1149/2207] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:36:58 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:37:00.621445 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-ea679791-d5fb-49d8-b1db-9c9bd3281836 req-c9f8e9c4-cf10-45fe-876e-be5239e6cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513f5cdb-61fc-49c2-bab7-66f56a53a045", "tag": "5cb0f394-d81f-41ee-a6e3-d97c6277f973"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:37:00.623047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:37:00.623047 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:37:00.630232 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-ea679791-d5fb-49d8-b1db-9c9bd3281836 req-c9f8e9c4-cf10-45fe-876e-be5239e6cd31 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:37:00.630680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-ea679791-d5fb-49d8-b1db-9c9bd3281836 req-c9f8e9c4-cf10-45fe-876e-be5239e6cd31 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:37:00.641967 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-ea679791-d5fb-49d8-b1db-9c9bd3281836 req-c9f8e9c4-cf10-45fe-876e-be5239e6cd31 service nova] Creating event network-changed:5cb0f394-d81f-41ee-a6e3-d97c6277f973 for instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 on hv-cinder-81713 Nov 09 05:37:00.646941 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-ea679791-d5fb-49d8-b1db-9c9bd3281836 req-c9f8e9c4-cf10-45fe-876e-be5239e6cd31 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029600 Nov 09 05:37:00.647525 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1059/2208] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:37:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:38:15.772451 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:38:15.772987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:38:15.779174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:15.779708 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:15.780539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:15.781170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:15.805592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:38:15.854814 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-b369a712-d0f4-42d7-b988-2f9b15f78d08 req-504ce578-7209-456a-a22f-2ab9d2047be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:38:15.856378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:38:15.856378 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:38:15.863791 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b369a712-d0f4-42d7-b988-2f9b15f78d08 req-504ce578-7209-456a-a22f-2ab9d2047be2 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:15.864235 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b369a712-d0f4-42d7-b988-2f9b15f78d08 req-504ce578-7209-456a-a22f-2ab9d2047be2 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:15.876369 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-b369a712-d0f4-42d7-b988-2f9b15f78d08 req-504ce578-7209-456a-a22f-2ab9d2047be2 service nova] Creating event network-changed:d0981ecd-ad8a-42b8-840f-33ac9b44003f for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 on hv-cinder-81713 Nov 09 05:38:15.881675 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-b369a712-d0f4-42d7-b988-2f9b15f78d08 req-504ce578-7209-456a-a22f-2ab9d2047be2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111027 Nov 09 05:38:15.882600 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1060/2209] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:38:15.896725 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-887b23e7-0d45-42d6-b751-61bfdab262f9 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "DELETE /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 204 len: 0 microversion: 2.1 time: 0.129030 Nov 09 05:38:15.898050 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1150/2210] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:38:15 2021] DELETE /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:38:15.906083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:38:15.906816 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:38:15.912854 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:15.913302 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:15.914072 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:15.914680 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:16.136332 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:38:16.143928 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-7db12b00-4362-4a39-a2ad-99ca8951161d tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1568 microversion: 2.1 time: 0.241888 Nov 09 05:38:16.153790 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1061/2211] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:38:15 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:38:17.161805 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:38:17.162499 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:38:17.169038 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:17.169458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:17.170231 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:17.170665 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:17.303954 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:38:17.311875 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3ed19fc5-7804-4126-858a-1d2255be7922 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1449 microversion: 2.1 time: 0.154066 Nov 09 05:38:17.312640 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1151/2212] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:38:17 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:38:18.283895 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-b16a8164-b27e-4daf-a08f-a731a8bef51d req-9564085b-fe17-4da2-8b5e-3bf25c831742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b9e5e-8a48-42a8-835e-f94fb65adf94", "name": "network-vif-deleted", "tag": "d0981ecd-ad8a-42b8-840f-33ac9b44003f"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:38:18.285433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:38:18.285433 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:38:18.292707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b16a8164-b27e-4daf-a08f-a731a8bef51d req-9564085b-fe17-4da2-8b5e-3bf25c831742 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:18.293145 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-b16a8164-b27e-4daf-a08f-a731a8bef51d req-9564085b-fe17-4da2-8b5e-3bf25c831742 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:18.303612 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-b16a8164-b27e-4daf-a08f-a731a8bef51d req-9564085b-fe17-4da2-8b5e-3bf25c831742 service nova] Creating event network-vif-deleted:d0981ecd-ad8a-42b8-840f-33ac9b44003f for instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 on hv-cinder-81713 Nov 09 05:38:18.308305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-b16a8164-b27e-4daf-a08f-a731a8bef51d req-9564085b-fe17-4da2-8b5e-3bf25c831742 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027985 Nov 09 05:38:18.308894 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1062/2213] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:38:18.328733 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:38:18.329371 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:38:18.336473 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:18.336918 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:18.338321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:18.338757 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:18.403184 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2457318b0094619b0fd1499f2c5732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc498cab6aa40d2b4929df08abc9e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:38:18.410514 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9b396a94-5831-4099-92c1-0ea10dbf52bb tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 200 len: 1220 microversion: 2.1 time: 0.085481 Nov 09 05:38:18.411065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1152/2214] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:38:18 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:38:19.428083 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:38:19.428660 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] [instance: 440b9e5e-8a48-42a8-835e-f94fb65adf94] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:38:19.434966 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:19.435413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:19.436205 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:38:19.436637 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:38:19.449462 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] HTTP exception thrown: Instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 could not be found. Nov 09 05:38:19.450042 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Returning 404 to user: Instance 440b9e5e-8a48-42a8-835e-f94fb65adf94 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:38:19.450841 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-55462c69-718d-41c9-a754-727d37dad5de tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94" status: 404 len: 111 microversion: 2.1 time: 0.027428 Nov 09 05:38:19.451352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1063/2215] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:38:19 2021] GET /compute/v2.1/servers/440b9e5e-8a48-42a8-835e-f94fb65adf94 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:38:19.604808 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9c0039bf-9335-425c-8d8d-56c71f784657 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] Calling method '.version_select at 0x7f30cc7f90d0>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:38:19.625718 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9c0039bf-9335-425c-8d8d-56c71f784657 tempest-TestShelveInstance-438209833 tempest-TestShelveInstance-438209833-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1158366711" status: 202 len: 0 microversion: 2.1 time: 0.025104 Nov 09 05:38:19.626439 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1153/2216] 10.222.0.41 () {58 vars in 1253 bytes} [Tue Nov 9 05:38:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1158366711 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 05:39:15.636228 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:15.636779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:15.643143 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:15.643598 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:15.644413 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:15.644852 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:15.672753 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:39:15.744522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6518ca0a-b5c7-4a8b-a0d8-27d0718119cb tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "DELETE /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 204 len: 0 microversion: 2.1 time: 0.111586 Nov 09 05:39:15.745138 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1064/2217] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:39:15 2021] DELETE /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:39:15.754615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:15.755218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:15.762568 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:15.763014 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:15.763811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:15.764234 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:15.895342 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:15.903249 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-31b0c438-be37-4f81-a554-fe5839e65460 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1577 microversion: 2.1 time: 0.153965 Nov 09 05:39:15.903836 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1154/2218] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:15 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:16.920835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:16.921520 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:16.927764 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:16.928209 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:16.928971 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:16.929400 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:17.077275 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:17.084563 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-60bc91c7-26f7-44bc-ba6e-9c50b882865b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1577 microversion: 2.1 time: 0.167734 Nov 09 05:39:17.085129 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1065/2219] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:16 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:18.101861 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:18.102689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:18.109639 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:18.110088 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:18.110866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:18.111302 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:18.251592 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:18.258977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3805af0a-a946-40c1-b324-037a60fd1117 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1577 microversion: 2.1 time: 0.160906 Nov 09 05:39:18.259563 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1155/2220] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:18 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:18.496861 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-c1b22bfa-57fd-4db5-b374-5dd3981c7663 req-bb4b5316-fc53-4903-829a-e844cd161244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513f5cdb-61fc-49c2-bab7-66f56a53a045", "name": "network-vif-deleted", "tag": "5cb0f394-d81f-41ee-a6e3-d97c6277f973"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:39:18.498510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:39:18.498510 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:39:18.505777 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-c1b22bfa-57fd-4db5-b374-5dd3981c7663 req-bb4b5316-fc53-4903-829a-e844cd161244 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:18.506223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-c1b22bfa-57fd-4db5-b374-5dd3981c7663 req-bb4b5316-fc53-4903-829a-e844cd161244 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:18.522953 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-c1b22bfa-57fd-4db5-b374-5dd3981c7663 req-bb4b5316-fc53-4903-829a-e844cd161244 service nova] Creating event network-vif-deleted:5cb0f394-d81f-41ee-a6e3-d97c6277f973 for instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 on hv-cinder-81713 Nov 09 05:39:18.528857 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-c1b22bfa-57fd-4db5-b374-5dd3981c7663 req-bb4b5316-fc53-4903-829a-e844cd161244 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035837 Nov 09 05:39:18.529497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1066/2221] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:39:19.277417 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:19.278011 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:19.284517 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:19.285015 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:19.285932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:19.286480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:19.324888 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:19.325580 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:19.326638 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.objects.instance [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lazy-loading 'fault' on Instance uuid 513f5cdb-61fc-49c2-bab7-66f56a53a045 {{(pid=115446) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 05:39:19.367866 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:19.374682 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-de60eba0-be94-4a72-8ef8-0c776d3a3a13 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 200 len: 1184 microversion: 2.1 time: 0.102171 Nov 09 05:39:19.375237 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1156/2222] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:19 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:20.392664 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:20.393350 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:20.399334 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:20.399811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:20.400579 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:20.401008 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:20.413538 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] HTTP exception thrown: Instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 could not be found. Nov 09 05:39:20.414111 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Returning 404 to user: Instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:39:20.414903 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c82d4681-bdfb-4222-98f0-14b609a9ad0f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 404 len: 111 microversion: 2.1 time: 0.026982 Nov 09 05:39:20.415410 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1067/2223] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:20 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:39:20.505689 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1333125727", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2044191353", "security_groups": [{"name": "tempest-secgroup-smoke-718520608"}], "block_device_mapping_v2": [{"uuid": "1f142f2b-6270-4c2d-94de-9b1caa6ac523", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d681ff-6cd4-4ae6-b07c-bd0311e9f7c5"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:39:20.614089 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] validate_networks() for [('11d681ff-6cd4-4ae6-b07c-bd0311e9f7c5', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:39:21.063350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:39:21.063819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:39:21.064298 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:39:21.064709 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:39:21.065147 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:39:21.073480 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:21.073925 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:21.074720 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:21.075148 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:21.090782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:39:21.094576 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for user 0e16463bf33240d8835e67a27448cdc9 and project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:39:21.148384 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:39:21.150487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f142f2b-6270-4c2d-94de-9b1caa6ac523',volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:39:21.268115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-6181dec8-7d2a-400d-93d3-7bd2a64fb397 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.765978 Nov 09 05:39:21.268908 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1157/2224] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 05:39:20 2021] POST /compute/v2.1/servers => generated 405 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 05:39:21.278366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-86e9c674-68ca-4428-ab84-0205a596d41e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:21.278976 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-86e9c674-68ca-4428-ab84-0205a596d41e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:21.331298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-86e9c674-68ca-4428-ab84-0205a596d41e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:21.337905 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-86e9c674-68ca-4428-ab84-0205a596d41e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1095 microversion: 2.1 time: 0.063181 Nov 09 05:39:21.338522 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1068/2225] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:21 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:22.356055 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:22.357244 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:22.364555 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:22.365138 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:22.366019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:22.366513 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:22.427784 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:22.435068 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aa7d07ac-3e5b-4bb0-ac5b-30d656d91796 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1211 microversion: 2.1 time: 0.083584 Nov 09 05:39:22.435681 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1158/2226] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:22 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:23.452943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:23.453547 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:23.460725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:23.461170 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:23.462152 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:23.462577 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:23.579288 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-1962ea11-ac98-4835-9b54-3916c99d53bb req-14704301-3411-4c92-8b63-c3cf1b16f0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63281a6a-9299-4dc6-b60e-ce6ad3fa3016", "tag": "35d1fa5b-df8e-46a9-a4f2-c5cf18172d84"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:39:23.582123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:39:23.582123 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:39:23.591758 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-1962ea11-ac98-4835-9b54-3916c99d53bb req-14704301-3411-4c92-8b63-c3cf1b16f0a4 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:23.592196 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-1962ea11-ac98-4835-9b54-3916c99d53bb req-14704301-3411-4c92-8b63-c3cf1b16f0a4 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:23.604333 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-1962ea11-ac98-4835-9b54-3916c99d53bb req-14704301-3411-4c92-8b63-c3cf1b16f0a4 service nova] Creating event network-changed:35d1fa5b-df8e-46a9-a4f2-c5cf18172d84 for instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 on hv-cinder-81713 Nov 09 05:39:23.609602 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-1962ea11-ac98-4835-9b54-3916c99d53bb req-14704301-3411-4c92-8b63-c3cf1b16f0a4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039028 Nov 09 05:39:23.610548 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1159/2227] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:39:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:39:23.697053 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:23.710367 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-febd47b7-eafb-47b9-8507-e29c2b4c00a1 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.261136 Nov 09 05:39:23.711728 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1069/2228] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:23 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:24.729775 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:24.730465 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:24.736462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:24.736905 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:24.737661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:24.738090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:24.869932 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:24.877270 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1a65f65f-cca5-4f10-abed-537f21fc4363 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.152560 Nov 09 05:39:24.877832 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1160/2229] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:24 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:25.893987 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:25.894593 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:25.900789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:25.901737 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:25.902496 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:25.902925 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:26.030093 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:26.037336 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-e44ef8da-6a32-41b3-bd3f-19f9818fefd8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.146993 Nov 09 05:39:26.037901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1070/2230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:25 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:27.054027 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:27.054632 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:27.061541 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:27.061983 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:27.062742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:27.063172 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:27.191774 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:27.198977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d411a717-94da-4294-8945-e1a38db0ffc6 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.148610 Nov 09 05:39:27.199558 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1161/2231] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:27 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:28.215634 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:28.216258 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:28.222314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:28.222765 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:28.223540 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:28.224004 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:28.358415 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:28.365962 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-fda4e171-4b32-4df9-af38-331677f10d7d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.153988 Nov 09 05:39:28.366526 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1071/2232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:28 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:29.383189 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:29.383811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:29.390527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:29.390962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:29.391738 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:29.392168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:29.528262 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:29.535340 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-17d40083-5f18-4c1a-bd5e-6fdce162b573 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.155887 Nov 09 05:39:29.535921 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1162/2233] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:29 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:30.551943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:30.552553 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:30.558872 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:30.559316 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:30.560131 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:30.560565 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:30.689230 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:30.696461 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6eabe48b-5cb0-415e-a3c3-8a9cdfd4244f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.148211 Nov 09 05:39:30.697025 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1072/2234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:30 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:31.714339 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:31.714944 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:31.721770 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:31.722222 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:31.723004 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:31.723440 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:31.870516 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:31.878166 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-16602ebc-e7b2-4eb3-84a0-8154a200563f tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.168305 Nov 09 05:39:31.878840 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1163/2235] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:31 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:39:32.894785 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:32.895386 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:32.902431 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:32.902906 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:32.903721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:32.904150 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:33.143911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:33.151189 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1828b7a6-9951-4dcb-b34c-38df4aebc717 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.259960 Nov 09 05:39:33.151892 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1073/2236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:32 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:33.785727 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-5b173e51-087b-4574-b7c0-d4e744783ca6 req-969f3e7c-4499-412f-8a6e-27a14f956bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63281a6a-9299-4dc6-b60e-ce6ad3fa3016", "name": "network-vif-plugged", "status": "completed", "tag": "35d1fa5b-df8e-46a9-a4f2-c5cf18172d84"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:39:33.787250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:39:33.787250 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:39:33.794590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-5b173e51-087b-4574-b7c0-d4e744783ca6 req-969f3e7c-4499-412f-8a6e-27a14f956bbb service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:33.795019 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-5b173e51-087b-4574-b7c0-d4e744783ca6 req-969f3e7c-4499-412f-8a6e-27a14f956bbb service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:33.805501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-5b173e51-087b-4574-b7c0-d4e744783ca6 req-969f3e7c-4499-412f-8a6e-27a14f956bbb service nova] Creating event network-vif-plugged:35d1fa5b-df8e-46a9-a4f2-c5cf18172d84 for instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 on hv-cinder-81713 Nov 09 05:39:33.810666 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-5b173e51-087b-4574-b7c0-d4e744783ca6 req-969f3e7c-4499-412f-8a6e-27a14f956bbb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093229 Nov 09 05:39:33.811227 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1164/2237] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:39:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:39:34.168642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:34.169249 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:34.175404 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:34.175883 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:34.176661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:34.177096 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:34.303265 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:34.310511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-65c0f1d2-01e4-4e53-9e3c-c2852a58c303 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.146013 Nov 09 05:39:34.311074 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1074/2238] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:34 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:35.328841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:35.329566 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:35.335780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:35.336223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:35.337071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:35.337501 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:35.525024 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:35.532819 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4241e108-34e7-4f62-8abb-81322b295c58 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1266 microversion: 2.1 time: 0.208534 Nov 09 05:39:35.533376 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1165/2239] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:35 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:36.550305 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:36.550901 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:36.558022 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:36.558469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:36.559251 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:36.559721 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:36.689398 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:36.696673 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-1ea2a110-bdbe-4cac-8f9d-9dd8067e4274 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1454 microversion: 2.1 time: 0.150111 Nov 09 05:39:36.697238 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1075/2240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:36 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:36.712512 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:39:36.713115 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:39:36.719458 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:36.719960 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:36.720745 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:36.721168 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:36.853065 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:39:36.860535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1fbac755-f922-4237-a2e9-83ebce5e3508 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1454 microversion: 2.1 time: 0.151595 Nov 09 05:39:36.861091 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1166/2241] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:39:36 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:39:38.469524 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-ea07ad2f-fb7f-4ed8-bfe2-62239fe52718 req-ecbf5e76-6125-41f6-96b7-ce9970deda8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63281a6a-9299-4dc6-b60e-ce6ad3fa3016", "tag": "35d1fa5b-df8e-46a9-a4f2-c5cf18172d84"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:39:38.471065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:39:38.471065 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:39:38.478175 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-ea07ad2f-fb7f-4ed8-bfe2-62239fe52718 req-ecbf5e76-6125-41f6-96b7-ce9970deda8f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:39:38.478621 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-ea07ad2f-fb7f-4ed8-bfe2-62239fe52718 req-ecbf5e76-6125-41f6-96b7-ce9970deda8f service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:39:38.490481 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-ea07ad2f-fb7f-4ed8-bfe2-62239fe52718 req-ecbf5e76-6125-41f6-96b7-ce9970deda8f service nova] Creating event network-changed:35d1fa5b-df8e-46a9-a4f2-c5cf18172d84 for instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 on hv-cinder-81713 Nov 09 05:39:38.495690 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-ea07ad2f-fb7f-4ed8-bfe2-62239fe52718 req-ecbf5e76-6125-41f6-96b7-ce9970deda8f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087073 Nov 09 05:39:38.496509 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1076/2242] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:39:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 05:39:54.478908 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:39:54.479554 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:39:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:41:31.737577 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:41:31.738093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:41:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:41:31.748173 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:41:31.748676 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:41:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:41:38.507771 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:41:38.508371 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:41:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:41:47.381268 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1313312104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2044191353", "security_groups": [{"name": "tempest-secgroup-smoke-718520608"}], "block_device_mapping_v2": [{"uuid": "6f579875-b858-490d-a1d6-6941b69e25fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d681ff-6cd4-4ae6-b07c-bd0311e9f7c5"}]}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:41:47.489650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.network.neutron [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] validate_networks() for [('11d681ff-6cd4-4ae6-b07c-bd0311e9f7c5', None, None, None, None, None)] {{(pid=115446) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 05:41:47.873488 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Flavor limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 05:41:47.873912 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Image limits 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 05:41:47.874385 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Flavor pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 05:41:47.874807 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Image pref 0:0:0 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 05:41:47.875220 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.virt.hardware [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115446) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 05:41:47.889350 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:47.889791 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:47.890590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:47.891020 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:47.906788 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 05:41:47.910659 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.quota [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Getting quotas for user 0e16463bf33240d8835e67a27448cdc9 and project 3fdba2411572461f8bf1e42d4eac42db. Resources: {'instances', 'cores', 'ram'} {{(pid=115446) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 05:41:47.963590 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Going to run 1 instances... {{(pid=115446) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 05:41:47.965732 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f579875-b858-490d-a1d6-6941b69e25fb',volume_size=None,volume_type=None)] {{(pid=115446) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 05:41:48.087133 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-d5a4cec1-ce13-471b-b2a2-84baac650a1d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709947 Nov 09 05:41:48.087998 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1167/2243] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 9 05:41:47 2021] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 05:41:48.098824 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-529b9606-23c5-48bf-85d2-0ad4eb71f253 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:48.099511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-529b9606-23c5-48bf-85d2-0ad4eb71f253 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:48.154091 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-529b9606-23c5-48bf-85d2-0ad4eb71f253 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:48.161849 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-529b9606-23c5-48bf-85d2-0ad4eb71f253 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1095 microversion: 2.1 time: 0.067840 Nov 09 05:41:48.162542 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1077/2244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:48 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:49.178321 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:49.178957 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:49.185988 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:49.186373 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:49.187149 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:49.187521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:49.253783 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:49.264510 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4c3afded-c666-4729-85bb-baf00457cfd7 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1211 microversion: 2.1 time: 0.089823 Nov 09 05:41:49.265086 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1168/2245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:49 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:50.282005 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:50.282607 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:50.289835 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:50.290224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:50.291009 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:50.291438 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:50.517759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:50.525759 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-45684ab0-d95c-4867-8aa8-b37f29b5f7ac tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.247391 Nov 09 05:41:50.526317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1078/2246] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:50 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:50.798556 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-97d6e05e-866f-4cfc-87af-96e29cbe6867 req-c4afe3e2-2b02-4f16-9fc6-88d5aadbd3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcc61ee-af4c-4954-a76c-fa194d34669b", "tag": "6c2e581f-0f89-4b20-9783-44ad51955248"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:41:50.800071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:41:50.800071 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:41:50.807782 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-97d6e05e-866f-4cfc-87af-96e29cbe6867 req-c4afe3e2-2b02-4f16-9fc6-88d5aadbd3d6 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:50.808281 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-97d6e05e-866f-4cfc-87af-96e29cbe6867 req-c4afe3e2-2b02-4f16-9fc6-88d5aadbd3d6 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:50.821248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-97d6e05e-866f-4cfc-87af-96e29cbe6867 req-c4afe3e2-2b02-4f16-9fc6-88d5aadbd3d6 service nova] Creating event network-changed:6c2e581f-0f89-4b20-9783-44ad51955248 for instance 1dcc61ee-af4c-4954-a76c-fa194d34669b on hv-cinder-81713 Nov 09 05:41:50.826093 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-97d6e05e-866f-4cfc-87af-96e29cbe6867 req-c4afe3e2-2b02-4f16-9fc6-88d5aadbd3d6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031189 Nov 09 05:41:50.826722 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1169/2247] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:41:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:41:51.543355 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:51.544120 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:51.550195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:51.550644 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:51.551992 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:51.552425 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:51.777298 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:51.784725 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-c9554397-7c48-4b95-968c-cc8c3940161e tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.246323 Nov 09 05:41:51.785363 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1079/2248] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:51 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:52.802615 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:52.803300 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:52.809337 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:52.809778 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:52.810535 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:52.810962 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:52.940613 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:52.947923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1f05b408-3a43-45bc-b0f9-97c94114ae49 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.150291 Nov 09 05:41:52.948478 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1170/2249] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:52 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:53.964580 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:53.965188 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:53.971494 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:53.971978 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:53.972749 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:53.973182 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:54.111317 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:54.119106 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-6d6dcd2f-c080-4d79-9afc-d9d319939dc8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.158259 Nov 09 05:41:54.119678 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1080/2250] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:53 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:55.136191 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:55.136792 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:55.142980 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:55.143427 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:55.144218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:55.144649 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:55.271266 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:55.278416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4f3394bb-754d-4a9a-bc50-51983a3c41ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.145881 Nov 09 05:41:55.278975 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1171/2251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:55 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:56.295352 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:56.295911 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:56.302672 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:56.303115 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:56.303917 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:56.304351 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:56.434080 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:56.441224 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-4246a040-9b04-4f20-abb0-1e7ce959dcd9 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.149636 Nov 09 05:41:56.441779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1081/2252] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:56 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:57.458408 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:57.459008 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:57.465372 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:57.465811 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:57.466571 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:57.466999 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:57.601215 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:57.608459 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-faae3105-a47b-4925-8bca-53e714973d2b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.154341 Nov 09 05:41:57.609023 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1172/2253] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:57 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:58.625898 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:58.626511 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:58.632776 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:58.633223 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:58.633991 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:58.634420 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:58.762936 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:58.770798 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2b0a1fa1-17fe-454e-8dc1-38f1ba50e690 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.147987 Nov 09 05:41:58.771358 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1082/2254] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:58 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:41:59.787176 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:41:59.787829 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:41:59.794083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:59.794521 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:59.795285 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:41:59.795736 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:41:59.923039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:41:59.930843 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-70c39b88-2fdf-40da-a1ea-0ff566f464a3 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.147250 Nov 09 05:41:59.931398 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1173/2255] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:41:59 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:42:00.947707 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:42:00.948353 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:42:00.954446 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:00.954893 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:00.955689 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:00.956119 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:01.088871 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:42:01.096360 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-ea42aa4c-946a-4b7d-a065-b74e3d249ed8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.152329 Nov 09 05:42:01.096921 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1083/2256] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:42:00 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:42:02.113084 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:42:02.113684 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:42:02.122395 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:02.123174 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:02.124018 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:02.124446 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:02.264742 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:42:02.272039 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-574dc1a9-8118-4bf0-b448-5b65ee4dedd5 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.162799 Nov 09 05:42:02.272611 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1174/2257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:42:02 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:42:02.431200 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-0546967f-374a-4393-927e-7bc0ff0a29d9 req-260599ad-5fc1-4f6f-85e1-7550294cd28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcc61ee-af4c-4954-a76c-fa194d34669b", "name": "network-vif-plugged", "status": "completed", "tag": "6c2e581f-0f89-4b20-9783-44ad51955248"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:42:02.432723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:42:02.432723 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:42:02.441507 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-0546967f-374a-4393-927e-7bc0ff0a29d9 req-260599ad-5fc1-4f6f-85e1-7550294cd28e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:02.441951 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-0546967f-374a-4393-927e-7bc0ff0a29d9 req-260599ad-5fc1-4f6f-85e1-7550294cd28e service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:02.453104 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-0546967f-374a-4393-927e-7bc0ff0a29d9 req-260599ad-5fc1-4f6f-85e1-7550294cd28e service nova] Creating event network-vif-plugged:6c2e581f-0f89-4b20-9783-44ad51955248 for instance 1dcc61ee-af4c-4954-a76c-fa194d34669b on hv-cinder-81713 Nov 09 05:42:02.458252 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-0546967f-374a-4393-927e-7bc0ff0a29d9 req-260599ad-5fc1-4f6f-85e1-7550294cd28e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031079 Nov 09 05:42:02.458829 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1084/2258] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:42:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:42:03.288872 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:42:03.289543 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:42:03.295841 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:03.296287 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:03.297056 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:03.297490 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:03.426868 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:42:03.433977 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-3102e794-d510-49db-af2a-5b8045354b90 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1266 microversion: 2.1 time: 0.148880 Nov 09 05:42:03.434619 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1175/2259] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:42:03 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:42:04.452123 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:42:04.452811 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:42:04.460133 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:04.460574 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:04.461339 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:04.461767 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:04.597089 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:42:04.605095 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-3f5fa2ca-baad-43ae-bff4-534bf0e1fee8 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1453 microversion: 2.1 time: 0.157035 Nov 09 05:42:04.605661 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1085/2260] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:42:04 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:42:04.621527 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:42:04.622129 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:42:04.628289 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:04.628731 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:04.629483 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:04.629943 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:04.756435 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:42:04.763696 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-53a3dce2-d291-4fb3-8b1d-e2b650056286 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1453 microversion: 2.1 time: 0.145724 Nov 09 05:42:04.764261 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1176/2261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:42:04 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:42:06.677586 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-a62a4a9f-1f27-425f-af8a-6d1bc66436ac req-273593b7-1818-4c33-8268-570eb733c470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcc61ee-af4c-4954-a76c-fa194d34669b", "tag": "6c2e581f-0f89-4b20-9783-44ad51955248"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:42:06.679922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:42:06.679922 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:42:06.687240 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-a62a4a9f-1f27-425f-af8a-6d1bc66436ac req-273593b7-1818-4c33-8268-570eb733c470 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:42:06.687704 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-a62a4a9f-1f27-425f-af8a-6d1bc66436ac req-273593b7-1818-4c33-8268-570eb733c470 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:42:06.698779 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-a62a4a9f-1f27-425f-af8a-6d1bc66436ac req-273593b7-1818-4c33-8268-570eb733c470 service nova] Creating event network-changed:6c2e581f-0f89-4b20-9783-44ad51955248 for instance 1dcc61ee-af4c-4954-a76c-fa194d34669b on hv-cinder-81713 Nov 09 05:42:06.703918 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-a62a4a9f-1f27-425f-af8a-6d1bc66436ac req-273593b7-1818-4c33-8268-570eb733c470 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030657 Nov 09 05:42:06.704738 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1086/2262] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:42:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:43:14.496989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:43:14.497668 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:43:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:43:57.818613 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72aeebc8-7b41-4ca4-acaa-c7dc623a4daa] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 09 05:43:57.822539 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-05def164-df18-450b-8d69-cf90ace278ae req-23079bf9-fdc5-40e9-ab06-96705f546439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcc61ee-af4c-4954-a76c-fa194d34669b", "tag": "6c2e581f-0f89-4b20-9783-44ad51955248"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:43:57.824012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:43:57.824012 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:43:57.827223 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:43:57.827780 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:43:57.831930 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-05def164-df18-450b-8d69-cf90ace278ae req-23079bf9-fdc5-40e9-ab06-96705f546439 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:57.832366 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-05def164-df18-450b-8d69-cf90ace278ae req-23079bf9-fdc5-40e9-ab06-96705f546439 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:57.834202 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:57.834839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:57.835634 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:57.836239 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:57.843300 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-05def164-df18-450b-8d69-cf90ace278ae req-23079bf9-fdc5-40e9-ab06-96705f546439 service nova] Creating event network-changed:6c2e581f-0f89-4b20-9783-44ad51955248 for instance 1dcc61ee-af4c-4954-a76c-fa194d34669b on hv-cinder-81713 Nov 09 05:43:57.848592 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-05def164-df18-450b-8d69-cf90ace278ae req-23079bf9-fdc5-40e9-ab06-96705f546439 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031730 Nov 09 05:43:57.851166 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1087/2263] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:43:57.860867 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Going to try to terminate instance {{(pid=115446) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:43:57.944120 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-8406af7a-8e7d-4ad3-8203-4362d2c21c54 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 204 len: 0 microversion: 2.1 time: 0.132192 Nov 09 05:43:57.947710 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1177/2264] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:43:57 2021] DELETE /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:43:57.956314 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:43:57.957516 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:43:57.963641 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:57.964102 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:57.965068 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:57.965512 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:58.192508 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:43:58.200430 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-64e27324-6a50-469f-8d8f-a049053979ee tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1578 microversion: 2.1 time: 0.250216 Nov 09 05:43:58.201324 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1088/2265] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:43:57 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1578 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:43:59.219033 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:43:59.219737 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:43:59.226040 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:59.226487 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:59.227247 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:43:59.227697 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:43:59.361416 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:43:59.369923 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-cd882bab-4fa1-419a-a8f2-2aa681ad882a tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1459 microversion: 2.1 time: 0.154928 Nov 09 05:43:59.370498 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1178/2266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:43:59 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:44:00.386090 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:00.386776 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:00.392945 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:00.393387 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:00.394165 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:00.394993 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:00.417518 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] [72aeebc8-7b41-4ca4-acaa-c7dc623a4daa] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50904. Nov 09 05:44:00.463528 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:44:00.471800 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-519e351b-c471-4daa-af6b-295e85a5e711 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 200 len: 1392 microversion: 2.1 time: 0.088906 Nov 09 05:44:00.472267 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [req-ff134e0b-5faa-4267-b3b9-59768ff0d833 req-f113cf0c-adc3-4e47-876c-12052f24d2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcc61ee-af4c-4954-a76c-fa194d34669b", "name": "network-vif-deleted", "tag": "6c2e581f-0f89-4b20-9783-44ad51955248"}]} {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:44:00.473844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:44:00.473844 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: warnings.warn(msg) Nov 09 05:44:00.475976 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1179/2267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:00 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 1392 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 05:44:00.480671 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-ff134e0b-5faa-4267-b3b9-59768ff0d833 req-f113cf0c-adc3-4e47-876c-12052f24d2d5 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:00.481117 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [req-ff134e0b-5faa-4267-b3b9-59768ff0d833 req-f113cf0c-adc3-4e47-876c-12052f24d2d5 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:00.491989 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.compute.server_external_events [req-ff134e0b-5faa-4267-b3b9-59768ff0d833 req-f113cf0c-adc3-4e47-876c-12052f24d2d5 service nova] Creating event network-vif-deleted:6c2e581f-0f89-4b20-9783-44ad51955248 for instance 1dcc61ee-af4c-4954-a76c-fa194d34669b on hv-cinder-81713 Nov 09 05:44:00.497403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [req-ff134e0b-5faa-4267-b3b9-59768ff0d833 req-f113cf0c-adc3-4e47-876c-12052f24d2d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119507 Nov 09 05:44:00.497979 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1089/2268] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:44:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:44:01.489481 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:01.489987 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 1dcc61ee-af4c-4954-a76c-fa194d34669b] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:01.496256 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:01.496702 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:01.497462 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:01.497892 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:01.511248 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] HTTP exception thrown: Instance 1dcc61ee-af4c-4954-a76c-fa194d34669b could not be found. Nov 09 05:44:01.511850 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Returning 404 to user: Instance 1dcc61ee-af4c-4954-a76c-fa194d34669b could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:44:01.512661 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b3f28f9e-33c3-44ac-8015-a36d1ec4fb55 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b" status: 404 len: 111 microversion: 2.1 time: 0.027783 Nov 09 05:44:01.513188 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1180/2269] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:01 2021] GET /compute/v2.1/servers/1dcc61ee-af4c-4954-a76c-fa194d34669b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:44:04.811001 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:04.811745 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:04.812806 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-e80d0ecf-9331-45d4-bfa8-09a7d88a7c02 req-f562140e-ae50-4b32-ae65-7e43f07e4d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63281a6a-9299-4dc6-b60e-ce6ad3fa3016", "tag": "35d1fa5b-df8e-46a9-a4f2-c5cf18172d84"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:44:04.814378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:44:04.814378 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:44:04.819610 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:04.820099 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:04.820827 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:04.821269 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:04.822061 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-e80d0ecf-9331-45d4-bfa8-09a7d88a7c02 req-f562140e-ae50-4b32-ae65-7e43f07e4d21 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:04.822562 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-e80d0ecf-9331-45d4-bfa8-09a7d88a7c02 req-f562140e-ae50-4b32-ae65-7e43f07e4d21 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:04.833680 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-e80d0ecf-9331-45d4-bfa8-09a7d88a7c02 req-f562140e-ae50-4b32-ae65-7e43f07e4d21 service nova] Creating event network-changed:35d1fa5b-df8e-46a9-a4f2-c5cf18172d84 for instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 on hv-cinder-81713 Nov 09 05:44:04.838723 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-e80d0ecf-9331-45d4-bfa8-09a7d88a7c02 req-f562140e-ae50-4b32-ae65-7e43f07e4d21 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029686 Nov 09 05:44:04.839687 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1181/2270] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:44:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:44:04.849088 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Going to try to terminate instance {{(pid=115445) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 05:44:04.931943 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-2060de7b-3b0d-499d-839d-d348425fc53b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "DELETE /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 204 len: 0 microversion: 2.1 time: 0.124945 Nov 09 05:44:04.933331 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1090/2271] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:44:04 2021] DELETE /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 05:44:04.942083 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:04.942773 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:04.949379 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:04.949822 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:04.950589 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:04.951012 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:05.087771 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.policy [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115446) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:44:05.097539 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-16238910-fa9b-4746-9821-07e1f7afc85b tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1578 microversion: 2.1 time: 0.159852 Nov 09 05:44:05.098113 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1182/2272] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:04 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:44:06.114789 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:06.115469 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:06.121666 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:06.122105 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:06.122867 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:06.123295 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:06.253079 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:44:06.260453 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-93c9509b-cbb9-4b6f-8e11-1e6905b5c8fa tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1460 microversion: 2.1 time: 0.149893 Nov 09 05:44:06.261017 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1091/2273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:06 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:44:07.184668 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [req-30ec3e4e-8d6d-45b0-8f38-ef07ef22322a req-518b7da4-4ee0-4bb2-bf39-c55662ad6498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63281a6a-9299-4dc6-b60e-ce6ad3fa3016", "name": "network-vif-deleted", "tag": "35d1fa5b-df8e-46a9-a4f2-c5cf18172d84"}]} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 05:44:07.186170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 05:44:07.186170 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: warnings.warn(msg) Nov 09 05:44:07.193979 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-30ec3e4e-8d6d-45b0-8f38-ef07ef22322a req-518b7da4-4ee0-4bb2-bf39-c55662ad6498 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:07.194431 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [req-30ec3e4e-8d6d-45b0-8f38-ef07ef22322a req-518b7da4-4ee0-4bb2-bf39-c55662ad6498 service nova] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:07.208233 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.compute.server_external_events [req-30ec3e4e-8d6d-45b0-8f38-ef07ef22322a req-518b7da4-4ee0-4bb2-bf39-c55662ad6498 service nova] Creating event network-vif-deleted:35d1fa5b-df8e-46a9-a4f2-c5cf18172d84 for instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 on hv-cinder-81713 Nov 09 05:44:07.215204 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [req-30ec3e4e-8d6d-45b0-8f38-ef07ef22322a req-518b7da4-4ee0-4bb2-bf39-c55662ad6498 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Nov 09 05:44:07.215818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1183/2274] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 9 05:44:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 05:44:07.278739 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:07.279403 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:07.286362 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:07.286813 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:07.287604 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:07.288066 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:07.345497 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.policy [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e16463bf33240d8835e67a27448cdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdba2411572461f8bf1e42d4eac42db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115445) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 05:44:07.353650 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b0ee8b24-194d-4c45-a457-6e1d86d8a94d tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 200 len: 1226 microversion: 2.1 time: 0.079461 Nov 09 05:44:07.354216 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1092/2275] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:07 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 05:44:08.370382 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:08.371099 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 63281a6a-9299-4dc6-b60e-ce6ad3fa3016] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:08.378064 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:08.378509 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:08.379267 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:08.379719 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:08.392245 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] HTTP exception thrown: Instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 could not be found. Nov 09 05:44:08.392818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Returning 404 to user: Instance 63281a6a-9299-4dc6-b60e-ce6ad3fa3016 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:44:08.394181 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-302307d7-d86d-4040-857b-4767b1d955a4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016" status: 404 len: 111 microversion: 2.1 time: 0.027905 Nov 09 05:44:08.394693 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1184/2276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:08 2021] GET /compute/v2.1/servers/63281a6a-9299-4dc6-b60e-ce6ad3fa3016 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:44:08.834278 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:08.834783 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.compute.api [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115445) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:08.841015 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:08.841450 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:08.842210 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:08.842642 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG oslo_concurrency.lockutils [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:08.855178 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.wsgi [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] HTTP exception thrown: Instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 could not be found. Nov 09 05:44:08.855784 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Returning 404 to user: Instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 could not be found. {{(pid=115445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:44:08.856582 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-b0d5780d-dd7a-42b6-b136-2da41aa411d4 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "DELETE /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 404 len: 111 microversion: 2.1 time: 0.026029 Nov 09 05:44:08.857092 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1093/2277] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 9 05:44:08 2021] DELETE /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:44:08.865739 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:08.866349 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.compute.api [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] [instance: 513f5cdb-61fc-49c2-bab7-66f56a53a045] Fetching instance by UUID {{(pid=115446) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 05:44:08.872199 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:08.872650 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:08.873407 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 05:44:08.873839 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Lock "37efc4e6-05c3-46b6-81a9-5d64f9690a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 05:44:08.887218 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] HTTP exception thrown: Instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 could not be found. Nov 09 05:44:08.887830 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Returning 404 to user: Instance 513f5cdb-61fc-49c2-bab7-66f56a53a045 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 05:44:08.888641 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c9fef20e-d5f3-44e5-aaee-5517392ad6b2 tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045" status: 404 len: 111 microversion: 2.1 time: 0.027531 Nov 09 05:44:08.889159 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1185/2278] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 9 05:44:08 2021] GET /compute/v2.1/servers/513f5cdb-61fc-49c2-bab7-66f56a53a045 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 05:44:10.166767 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: DEBUG nova.api.openstack.wsgi [None req-827e5485-ad61-47b8-95ee-d3ffba8e8d6c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] Calling method '.version_select at 0x7f30bfd8c550>' {{(pid=115445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 05:44:10.187712 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO nova.api.openstack.requestlog [None req-827e5485-ad61-47b8-95ee-d3ffba8e8d6c tempest-TestVolumeBootPattern-1038270379 tempest-TestVolumeBootPattern-1038270379-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2044191353" status: 202 len: 0 microversion: 2.1 time: 0.024602 Nov 09 05:44:10.188287 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: [pid: 115445|app: 0|req: 1094/2279] 10.222.0.41 () {58 vars in 1262 bytes} [Tue Nov 9 05:44:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2044191353 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 05:44:51.765825 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:44:51.766392 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:44:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:44:51.777574 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Traceback (most recent call last): Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: timer() Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: cb(*args, **kw) Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: waiter.switch() Nov 09 05:44:51.777741 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: greenlet.error: cannot switch to a different thread Nov 09 05:46:34.515532 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:46:34.516195 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:46:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:46:38.527635 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:46:38.528290 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:46:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:47:01.952588 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:47:01.953127 dv-cinder-817135-2-iscsi devstack@n-api.service[115445]: Tue Nov 9 05:47:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:47:04.247265 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:47:04.247818 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:47:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 05:48:11.783353 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 05:48:11.783992 dv-cinder-817135-2-iscsi devstack@n-api.service[115446]: Tue Nov 9 05:48:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!